






Otc fo 


PERIODICAL ROOM 
GBNERAL LISRARY &© in 
UNIV, OF MICH, 


Vol. 41 FEBRUARY, 1950 No. 2. 


The Journal of Educational 
Psychology 


Devoted Primarily to the Scientific Study of Problems of Learning and Teaching 





CONTENTS 


Studtes of the Group Rorschach in Relation to Success in the College 
of the University of Chicago. .......2.2.2.2.2.2.. 65 


LEE J. CRONBACH 


A Note on the Evaluation of College Remedial Reading Courses 83 
H. A. ROBINSON 


Truancy and Classroom Disorder as Symptoms of Personality 
SS, go. 5 cee wk blak Cal ee BE oie) Bute 5 ee 97 


FRANCES A. MULLEN 


Factors in State Characteristics Related to Average A-12 V-12 Test 
BR? ee bl Gok a a,c: im ow cacao DE MID fs kaw Bek 110 
K. 8. DAVENPORT AND H. H. REMMERS 


Use of the Minnesota Multiphasic Personality Inventory in Screen- 
ing College Students for Counseling Purposes... ..... 116 
GLENN R. HAWKES 


$6.00 per Year - Published Monthly October to May 


WARWICK & YORK, INC. 
BALTIMORE 2, MD. 


Entered as Second Class Matter Nov. 15, 1921, at the Post Office at Baltimore, Md. 
under the Act of March 3, 1879; additional entry as Second Class Matter at York, Pa. i 








THE JOURNAL OF 
Educational Psychology 


Established 1910 


EDITORIAL BOARD 


STEPHEN M. Corey Rosert T. Rock, Jr. 

Teachers College, Columbia University Fordham University 
—Learning— —Individual Differences— 
Jack W. Dun tap PercivaL M. Symonps 
to E. 49th St., New York 17, N.Y. Teachers College, Columbia University 
—Technical, Statistics— —Mental Hygiene— 
Karu J. Houizincer Mites A. TINKER 
University of Chicago University of Minnesota 
—Factor Analysis— —Reading— 
Harotp E. Jones ALEXANDER G. WESMAN 
University of California The Psychological Corporation 
—Social Behavior, Child Psychology— —Tests— 
H. H. RemMMeERs Paut A. Witty 
Purdue University Northwestern University 
—Attitudes, Teacher Evaluation— —Children’s Interests— 

H. E. Bucnwouz 
Managing Editor 
10 E. Centre St., Baltimore 2, Md. 


v= JournaL oF Epucationat Psycuo.ocy is devoted pri- 

marily to the scientific study of problems of learning, teaching, 
and measurement of the psychological development of the indi- 
vidual. The Journat will contain articles on the following sub- 
jects: the psychology of school subjects; experimental studies of 
earning; the development of interests, attitudes, and personality, 
particularly as related to school adjustment; emotion, motivation, 
and character; mental development and methods. This last will 
include tests, statistical techniques, and research techniques in 
cross-sectional and developmental studies. 





Manuscripts may be submitted to any member of the Editorial 
Board, but the handling of an article will be facilitated if it is sent 
to that member of the Board who is designated as particularly 
interested in the phase of psychology dealt with. (Such designations 
appear after the Editors’ names in the list given above.) 

Books and other materials for review and correspondence 
regarding editorial matters should be addressed to The Journal 
of Educational Psychology, Warwick and York, Inc., Publishers, 
10 E. Centre St., Baltimore 5, M 2, Md. 





Manuscripts should be typed and double-spaced throughout, 
including quotations, footnotes, and references. In order to attain 


(Continued on Inside Back Cover) 








THE JOURNAL OF 
EDUCATIONAL PSYCHOLOGY 








Volume 41 February, 1950 Number 2 








STUDIES OF THE GROUP RORSCHACH 
IN RELATION TO SUCCESS IN THE COLLEGE 
OF THE UNIVERSITY OF CHICAGO* 


LEE J. CRONBACH 


Bureau of Research and Service 
College of Education, University of Illinois 


Widespread interest has been aroused by Munroe’s monograph‘ 
on the adjustment of college students and their scholastic suc- 
cess, in relation to predictions based on the Rorschach test. 
Munroe found that even a rapid scoring of the Group Rorschach 
yields a useful predictor of academic success, and that the test 
draws attention to students likely to need help in emotional 
adjustment. The Munroe study leaves need for further research, 
however. Sarah Lawrence College, with its methods of adapting 
the curriculum to the individual, is sufficiently atypical that 
findings there may not apply elsewhere. Further studies are 
also needed to obtain a clearer indication as to what aspects in 
the Rorschach performance contribute to the predictions. 

Many colleges have planned studies along the lines of the 
Munroe work. Some reports, generally supporting the claim 
that Rorschach data have predictive value, have appeared.**:? 
Some of this evidence, however, is weakened by faulty statistical 
reasoning.! The present study was begun as a direct repetition of 
the Munroe study, to predict academic success at the University 
of Chicago. As the study proceeded, the mass of data collected 
made several other studies possible. The present report is a 
statistical threshing of the material available. Clinical analysis 
is also planned at a later date. 





* This study was planned and the data were assembled by the University 
Examiner’s Office of the University of Chicago. Contributions to the study 
were made by Benjamin S. Bloom, George De Vos, Esther A. Frankle, and 
Harriet Moore. The present writer is primarily responsible for the analysis 


and interpretation. 
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Basic data.—The College of the University of Chicago is the 
top unit in a 6-4-4 system, comprising grades XI-—XIV of the 
usual ladder. According to the Chicago plan, students take 
general courses in several major areas, the work being presented 
principally through small discussion classes supplemented by a 
weekly lecture. The student is much less closely supervised 
than he would be in the usual high school. His official record of 
progress is based exclusively on comprehensive examinations 
given at the end of the school year, rather than on such bases as 
class attendance, teacher marks, and teacher-made tests given 
throughout the year. These tests are prepared, given, and 
marked by a central examining staff. While the testers work 
closely with the instructors in preparing tests, the final form of 
the examination is prepared by the examiner and the final grading 
is made without knowledge of the identity of the writer of each 
paper, and thus is free from certain types of bias. This practice 
provides an especially interesting and reliable criterion for a 
study of the Rorschach as a predictor. The examinations 
emphasize comprehension of principles and development of 
intellectual skills, rather than recall of isolated facts. 

In 1946, a group of three hundred students entering the College 
were given the Group Rorschach in the customary manner, and 
the American Council Psychological Examination. At the end 
of the year the comprehensive examinations in the Natural 
Sciences, Humanities, Foreign Languages, Social Sciences, 
Mathematics, and English were given. Subjects in the present 
study include only those students who took from three to five 
comprehensives in the first year; the grades were averaged, with 
equal weighting, to yield the grade point average which is the 
principal criterion in this study. 

The subjects tested are not representative of the usual ‘college 
freshman.’ Most are from homes which can afford a substantial 
tuition. ‘They have passed severe entrance hurdles. They are 
young, the median age being about fifteen. They are intellectu- 
ally extremely superior; on the ACE test, total score, approxi- 
mately fifty-three per cent surpass the ninetieth percentile of 
the national norms for thirteenth-graders. The group undoubt- 
edly have special motivations which cause them to seek out the 
University of Chicago program. 











Studies of the Group Rorschach 67 


Problems investigated.—The following questions are considered 
in this report: 

(1) What are the characteristics of these students in terms of 
the major categories? 

(2) How adequately does adjustment judged from the Ror- 
schach predict success at Chicago? Does it enhance prediction 
based on the ACE? 

(3) What signs in the Munroe check list are associated with 
academic overachievement or underachievement? 

(4) What signs are correlated with the ACE score, and with the 
difference between Q and L? The latter question was raised by 
Munroe’s study® that links the pattern of abilities to personality. 

(5) How does Rorschach performance relate to ratings of social 
adjustment and to personal effectiveness as measured by socio- 
metric techniques? 

It is the purpose of all these questions to identify the possible 
usefulness of the Group Rorschach in college personnel work. 

Analysis of the data.—Because of the intensive analysis planned, 
a thorough scoring of the Rorschach was made. A first scorer 
had marked the check list in a very rapid fashion, and treatment 
of the results showed that the data did not predict marks. But 
it was apparent that some responses which should have led to 
entries on the check list had been overlooked in the hasty scoring. 
In a rescoring by one of two new scorers, each Rorschach response 
was scored. The check list was then marked carefully by the 
scorer, and in many cases the checking was reviewed by the other 
scorer. The data may have been analyzed more intensively 
than Munroe’s records, which would lead to somewhat higher 
check-list scores, on the average, for this group.* The second 
scorers also assigned a letter grade indicating estimated adjust- 
ment, using Munroe’s scale,‘ (p. 21) which ranges from A (sound 
integration) to E (psychopathology). 

Contamination was eliminated by the facts that Rorschach 
findings were not made available to instructors or examiners, 
and that scorers marked the tests without knowing the students 
and without referring to non-test data other than age and sex. 





*In retrospect after completing the study, it appears that the rapid 
scoring gave neither better nor worse predictions than the more careful 


check-list scoring. 
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RESULTS 


Because time was not available for rescoring all records, only 
two hundred cases—a sample of the three hundred persons tested 
—were used. These are a random sample except that all seventy- 
two of the cases residing in college dormitories were included. 
Table I summarizes the distribution of cases. There were, in 
all, seventy-one men and one hundred twenty-nine women. In 
some analyses, the first-year group was treated separately from 
the advanced students. 


TaBLE I.—Supsects CLASSIFIED BY AGE, SEX, AND GRADE 
PLACEMENT (N = 200) 





Placement at Time of Entrance 





First Year | Second Year| Third Year | Fourth Year 














Age (11th grade)| (12th grade)| (13th grade)} (14th grade) 
Total 

Men| Women| Men! Women| Men! Women! Men! Women 
Below 15 4 2 0 0 1 0 0 0 7 
15-0 to 15-11 | 29 21 3 2 1 0 0 0 56 
16-0 to 16-11 | 24 16 7 7 0 0 0 0 54 
17-0 to 17-11 | 1 1 6 8 6 6 0 0 28 
18-0 to 18-11} 0 1 0 0 5 3 0 0 9 
19-0 to 19-11 | 2 0 0 0 1 2 0 0 5 
20-0 Over 2 0 0 0 29 2 8 0 41 
Total 62 41 16 17 43 13 8 0 200 





























RORSCHACH CHARACTERISTICS OF THE SAMPLE 


Our first question is what the Chicago group is like, as reflected 
in Rorschach performance. One way of looking at this is to see 
how frequently each of the Munroe ‘checks’ occurs, since a 
check is allowed for each variation in personality which may sug- 
gest adjustment difficulty. This tabulation is not so rich as a 
clinical analysis of each record would be, but it is relatively 
objective. The incidence of signs* in the Chicago group was as 
follows: 





* These signs are used as defined by Munroe‘ (pp. 87-101). 
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Over 50 per cent of the subjects showed: shading shock (83 
per cent), color shock (92 per cent; two checks given to 57 
per cent), FC— (56 per cent), C:M —(66 per cent). 

31-50 per cent of the subjects received one or more checks for: 
S+, AtSx+, F(B or V), FKFc—, m+, Total Movement-+, 
Total color—. 

20-30 per cent of the subjects received one or more checks for: 
W-+, Suc r, Range—, F per cent+, M+, M—, CF+. 


Munroe has provided us with the incidence of signs in one 
hundred twenty Sarah Lawrence freshmen (girls), entering in 
1945-1947. The general distribution of signs resembles that 
at Chicago, with certain marked exceptions. The following 
signs were noted by Munroe in at least ten per cent more cases 
than at Chicago: CF—, Range—, W+, Total mvt.+. The 
Chicago scorers noted these signs at least ten per cent more 
often: C+, Suc r, F(B), F(V), AtSx+, Total color—, 8+, 
FKFc—, m+, FC—, C:M-, shading shock, color shock. The 
most striking differences in incidence relate to shading shock 
(Chicago 83 per cent, Sarah Lawrence 35 per cent), color shock 
(92 per cent, 69 per cent), FC— (56 per cent, 28 per cent), m+ 
(46 per cent, 14 per cent), FKFce— (37 per cent, 7 per cent), and 
Suc r (27 per cent, 0 per cent). 

One cannot be sure that in a group having exceptional scho- 
lastic aptitude the signs of maladjustment are the same as those 
for persons representing a broader range of ability. Moreover, 
the differences in age and sex between the two samples are too 
great to permit confident interpretation of the comparison. 

If the conventional Rorschach interpretations hold for this 
group, the Chicago students show a larger number than usual of 
signs of emotional disturbance (shading and color shock, F(BV), 
AtSx, m), inflexibility (S, range, F per cent), and inward rather 
than outward orientation (M, color). The principal quantita- 
tively-scored difference from the Sarah Lawrence group appears 
to be in the color balance—Chicagoans tending relatively more 
toward C and CF than FC—and in the tensions represented by m. 
If the scoring in the two schools on more qualitative items such 
as color shock can be compared, the Chicagoans are also less 
flexible and more prone to emotion in threatening situations. 
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PREDICTION OF GRADE AVERAGE 


Does the Rorschach improve prediction of grades beyond that 
obtained from the ACE Test? The answer given by our data is 
almost completely negative. The correlations of grade average 
with several variables are as follows: 


with ACE Total .45 (first year), .39 (2d—-4th year) 
with number of Rorschach 

checks .17 (first year), .00 (other years) 
with Rorschach adjustment 

rating .25 (first year), .07 (other years) 


Positive correlations show that good adjustment is associated 
with good grades. For one hundred cases, a product-moment r of 
.00 has a standard error of .10. The correlation of Rorschach 
grade with ACE Total is .11 (first year), .29 (other years). <A 
multiple R computed from ACE and Rorschach grade is .49 


TaBLeE I].—RorscHacH ADJUSTMENT RATING COMBINED WITH 
ACE 1n RELATION TO ACADEMIC STANDING (FIRST-YEAR 























STUDENTS) 
High ACE Low ACE 
(22* and over) (Below 22) 
Rorschach Grand 
A or D or A or D or Total 
B C E Total B C E Total 
Grade average f 
3.0-3.9 8; 9 1] 18 6; 4 1 11 29 
2.0-2.9 6; 9 2) 17 4;15) 8] 27 44 
1.0-1.9 te te 4 4/11) 5] 20 24 
0.0-0.9 1 1 1 1; O 2 3 
Total number 16 | 20; 4] 40 15 | 31; 14; 60 | 100f 
Percentage earning min i aie 
3.0 and above 50 | 45) 25) 45 40; 13) 7] 18 9 
Percentage falling i o : 
below 2.0 12} 10) 25 13 33 | 39) 36] 37 2 
































* On a standard-score scale with mean 20, s.d. 4. 
t 3.0 equals B. 
t ACE scores were missing for three cases. 
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(first year), .39 (other years). The improvement over predic- 
tion from ACE alone is negligible. 

Table II, corresponding to Munroe’s Table VII‘ (p. 49), shows 
the grade distribution for each combination of ACE and Ror- 
schach standings for first-year students. There is some rela- 
tionship between the Rorschach and grades earned. Bright 
students tend not to earn high grades, unless they have at least 
a fair degree of adjustment. With low ACE score, students’ 
chances of receiving high grades rise or fall in proportion to their 
adjustment. The trend is insufficient to affect the multiple 
correlation appreciably. These sub-hypotheses regarding the 
interaction of Rorschach and ACE scores might prove to be 
significant in a larger sample of cases. 


CHARACTERISTICS FAVORING ACHIEVEMENT 


Even though the total Rorschach score does not predict 
achievement, there may be some traits revealed by the Rorschach 
which do correlate with academic success. The separate signs 
in the Munroe list were therefore correlated with tendency to 
underachieve. To do this, the scatter diagram between ACE 
Total and Grade Average (for all three hundred cases) was 
divided into two parts. The twenty-fifth percentile was found 
in each column representing an ACE score-interval, and a smooth 
line was drawn through these points. In the sample of one hun- 
dred ninety-seven cases for whom we had ACE scores and 
rescored Rorschachs, the line cut off sixty-eight underachievers. 
One hundred twenty-nine cases fell in the normal-to-superior 
group. This division permits comparison of students who differ 
in achievement with ACE score held constant. The failure to 
divide the group in the ratio 25:75 reflects smoothing and group- 
ing, rather than differences between the rescored group and the 
parent group. 

The two subgroups were compared on all the check-list entries, 
and on a few other scores. Relationships were generally negligi- 
ble. The relations in Table III are reported only as leads for 
further research. What trends there were seemed to be linear; 
no sign is characteristic of both overachievers and under- 
achievers to a greater degree than normal achievers. Not a 
single one of the forty-four relationships reaches significance by 
the chi-square test, both variables being dichotomized and 
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Yates’ correction being used. Virtually none of these signs are 
confirmed by Thompson’ as having a relation with grades, ACE 
score being held constant. There is no basis in the present study 
for advising further attempts to predict marks at Chicago by 
statistical treatment of Rorschach check-list entries. 


TABLE III.—RorscuHacw Signs Havine Positive But Non- 
SIGNIFICANT RELATIONS WITH UNDERACHIEVEMENT 

















Percentage Incidence 
Over- 
Characteristic achievers Under- Veet 
and 4 
. Achievers 
Normal (N = 68) 
Achievers = 
(N = 129) 
W- -- 10 19 28 
e+ 4¢4+ 44+ 19 10 25 
Tot Movement + ++ +++ 43 28 24 
FM + ++ +4++ 23 10 .22* 
Dd + ++ +++ 14 7 18 








* Product-moment r. 


CORRELATION WITH ACE SCORE 


Because there has been much interest in the possible relation 
between Rorschach performance and tested intelligence, a com- 
parison was made between the ACE total score and each of the 
check-list signs. In this high-level group, with restricted range, 
tetrachoric r’s were all small, save that FKFc— correlated —.45 
with ACE total. Chi-square, corrected, for FKFe was 9.3 
(but this was only one out of twenty-five significance tests in this 
section of the study, and is therefore barely significant if at all). 
Other non-significant correlations were Dd+, .40; FC—, —.30; 
C’+, .30, FM+, —.25; m+, .25; M+, .20. These associations 
are so low as to discourage attempts to make a statistical estimate 
of psychometric intelligence from the Rorschach signs in a 














Studies of the Group Rorschach 73 


group such as this. The unreliability of single-test signs would 
obscure any underlying relationship. High ACE score is associ- 
ated with presence of FKFc, Dd, FC, C’, m, and M responses, 
and associated with infrequent use of FM. In a corresponding 
study with less homogeneous subjects, Thompson’ found similar 
associations for M, FM, and m, and apparently for FC. Low 
Dd was found with high ACE in her group. Her scoring does 
not permit comparison of the two studies on FKFe and C’. 
On the other hand, she lists numerous correlations (significance 
not reported) of ACE with Rorschach signs which were found not 
to be differentiating in the Chicago group. Wittenborn’s 
recent study® of a small sample suggests that few relationships 
between Rorschach scores and mental ability exist for college 
students. He finds slight association of tested ability with 
R, M, and C’. 


THE Q-L DIFFERENTIAL 


Munroe found numerous Rorschach differences between girls 
with L higher than Q and girls with Q higher than L on the ACE. 
Our data are in slightly different form from Munroe’s, but permit 
further investigation of the same question. Because of the pre- 
selection of Chicago students, our cases come from a markedly 
different portion of the Q-L plane than hers. 

Our Higher L group consisted of all students whose standard 
score in L was at least 4% s.d. higher than their Q score. The 
Higher Q group consists of those whose Q score was at least 
¥ s.d. higher than their L score. There were nine, twenty- 
seven, and thirty girls, respectively, in the Higher Q, equal, and 
Higher L groups. In the same categories, there were respectively 
thirty-seven, forty-two, and forty-four men. Because of this 
sex difference, we tabulated Rorschach performances of the two 
sex groups separately. For significance tests among the girls, 
the equal and Higher Q groups were thrown together. Among 
men, significance tests were based on chi-square applied to the 
Higher Q versus the Higher L group. 

Absolutely no difference was found which could be considered 
statistically significant. On many items, small differences 
appeared in one sex but were accompanied by just the opposite 
difference in the other sex. Munroe reports five significant 
differences: Higher L is associated with high M per cent, high 
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total movement, high F(BV), high C’, and low F per cent. 
Among our sample of girls, there was no difference in F(BV), M, 
and Tot mvt., a difference confirming Munroe in F per cent, and 
a difference contrary to Munroe’sinC’. The tendency of Higher 
Q girls to show excess F per cent is not statistically significant, 
but it is in accord with previous reports by Wells* and Munroe. 
Among girls, the percentages receiving a check for overemphasis 
on F per cent were: Higher Q, 33; equal, 11; Higher L,7. Among 
boys, the percentages were 43, 31, and 26. 

In our sample there is no appreciable relation between Ror- 
schach scores and the ability pattern. It may be that this is a 
result of special characteristics of the Chicago sample. Even 
the lowest of the Higher Q students at Chicago probably has 
considerable ability along linguistic lines, or he would not have 
reached the College. Furthermore, the Chicago program, which 
stresses general education, may not attract students with extreme 
overspecialization in either the linguistic or quantitative direc- 
tions. Our results do definitely discourage generalization about 
“‘the type of personality likely to have Q greater than L,”’ and 
vice versa, until further research has been done on subjects of 


many levels and many ages. 


PREDICTION OF SOCIAL ADJUSTMENT 


Munroe found that Rorschach scores permitted her to predict 
which students would later show signs of maladjustment, as 
judged by their use of psychiatric service and other evidence. 
No criterion available at Chicago is directly comparable to 
Munroe’s. As one criterion of maladjustment, ratings from 
dormitory resident heads were obtained. For each first-year 
student living in a University residence hall (and this includes 
all those not residing at home in Chicago), the head of the 
dormitory unit in which he lived supplied a rating. Twelve 
raters were involved, each one rating from three to eleven stu- 
dents. No student was rated by two heads. The raters were 
professional people living in the dormitory and working with 
the students, but they had very limited psychological training. 
The rating was made on a five-point scale which paraphrased 
Munroe’s scale used in assigning Rorschach letter ratings of 


adjustment. 
The correlation of the Dormitory Rating with Rorschach letter 








Studies of the Group Rorschach 75 


rating is: for forty men, .38; for thirty-two women, .31; for both 
combined, .31. The first correlation is significant at the one 
per cent level, the second at the five per cent level; the null 
hypothesis may be rejected. In view of the doubtful reliability 
and validity of the criterion, the correlation encourages the 
belief that the Rorschach may prove useful in predicting social 
maladjustment in college. For number of checks, the correla- 
tions were: men, .27; women, .20; both, .24. Although we have 
no idea what to conclude, we must report the additional fact 
that for all cases combined the mere number of Rorschach 
responses correlates .33 with Dormitory Rating. 


RELATION OF RORSCHACH RESULTS TO SOCIOMETRIC RATINGS 


A second criterion of adjustment which may have considerable 
validity is a sociometric report obtained by Frankle.? Each 
resident of the dormitory was asked to rate each other resident 
of the same sex on a ‘Guess Who,’ or reputation, questionnaire. 
The questionnaire presented twenty bi-polar items; for example, 
““Which ones [in your dormitory] always seem cheerful and good- 
natured? Who are the ones who never look happy; always seem 
sad, worried, or frustrated?’”’ Each person was provided with 
a list of all students of like sex residing in any dormitory, and 
was asked to write after each question the name of any person on 
the list who fitted the description. Respondents were allowed 
to name several persons for one question, or to omit names if 
the description fitted no one. While the students had been liv- 
ing together for a year, the dormitories were physically divided 
into ‘entries,’ so that each person knew a few students in his 
entry better than others in the group whom he saw only at meal- 
times, in the lounge, and in general contact about the campus. 

Among the twenty traits, there were five, such as ‘shy versus 
show off,’ which could not be considered as having one ‘good’ 
pole. Eliminating these five items, the other items could be 
considered as providing an index of adjustment, since mention in 
connection with one of the questions was obviously a favorable 
report, and the other question implied unfavorable adjustment. 
Eleven of the traits are listed, in condensed wording, in Table IV. 
The total number of mentions under favorable traits, minus the 
number under unfavorable traits, was taken as a Sociometric 
Rating of adjustment. This score may be taken as anet appraisal 
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TABLE IV.—RELATIONS BETWEEN TRAITS AS REPORTED IN 
REPUTATION QUESTIONNAIRE AND SELECTED RORSCHACH CHECK- 


LIST ENTRIES 


The Journal of Educational Psychology 








Check-list Entries 


Magni- Having r Less 

tude of Than .20 with 

Tetra- Questionnaire 
Questionnaire Item Associated with choric r Item 


Always seems worried (vs. Shading shock .25 AtSx, F%, C’,M 
cheerful) Emphasis on Kk __ .50 
Makes people feel com- Emphasis on c .40 M, Col sh, C:M, 
fortable (vs. makes FC, FKFc, F% 
people uncomfortable) 
Jumpy, jittery (vs. calm, Emphasis on m .40° M 
unperturbed) 
Always has something to Underemphasison .40* M, F%, F(BVE) 
gripe about (vs. handles 
problems adaptively) Underemphasis on .25 
FKFc 
Underemphasis on _ .55 
FC 
Emphasis on CF .50 
Overemotional, excitable Underemphasison .40* M, F% 
(vs. cold and unmoved, FC 
overcontrols emotions) Emphasison CF  .35 
‘Show off,’ always trying Emphasis on Kk .20* Tot C,C:M, FKFe 
to attract attention (vs. Shading shock 40 
shy) Color shock 30 
Emphasis on CF .40 
Must be with other people Tot C, CiM, F% 
(vs. prefers to be by self) 
Acts like a ‘high-school Underemphasison .25* M, CF, FKFc, A% 
kid’ (vs. mature) FM 
Emphasis on FC .35* 
Emphasis on C .40 
High F% .25* 
Interested in the abstract, W 
theoretical (vs. concrete) 
Spontaneous, flexible (vs. Form not BVE .35 F%, M, CF 
rigid, can’t change views) 
Withdrawn from reality, Emphasis on M .65¢ F%, F(BVE) 
daydreams (vs. realistic Underemphasison .25* 


attitude) 


FM 


* Relationship is in direction opposite to that hypothesized. 
« Lowest marginal total is only 12 per cent; when cut near middle of m 


continuum, r drops to .12. 
6 No advance hypothesis as to probable direction of this relation. 


¢ Lowest marginal total is only 12 per cent; when cut is made near middle 
of M continuum, r drops to .05. 
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of the student by his peers. A large positive or large negative 
score is probably meaningful, although a score of zero could be 
achieved by a person with medium adjustment, by one whose 
good and bad mentions cancelled, or by one so inconspicuous 
that others were not acquainted with him and did not mention 
him. Because of the possibility that the number of ‘mentions’ 
might more nearly represent popularity than adjustment, the 
sociometric report was also scored by a weighted method, 
counting the number of traits on which the person had at least 
four more favorable than unfavorable mentions, minus the 
number of traits on which he has a net of four or more unfavor- 
able mentions. This gave results no different from the first 
scoring procedure. 

For men, the Sociometric Rating correlates .284 with Ror- 
schach adjustment rating; for women, the correlation is .140; 
for both, .196. The correlations for men and for the total group 
are significant at the five per cent level. But for all cases com- 
bined, the number of Rorschach responses correlates .37 with 
the Sociometric Rating! 

Many of the trait-descriptions in the reputation questionnaire 
employed terms often used in interpreting the meaning of specific 
Rorschach signs. For example, high F per cent is often thought 
to be associated with overcontrol. An examination of the corre- 
lation between F per cent and frequency of mention on the 
characteristic ‘overcontrols emotions’ is an unusually direct 
method of determining the validity of description from Rorschach 
scores. Eachitem in the Reputation Questionnaire was examined, 
and a list made of all the Rorschach check-list entries that might 
be expected to correlate with that item, in view of the meanings 
equated with Rorschach scores in the Rorschach literature. A 
tetrachoric correlation was then computed between the score of 
the student on the bi-polar item (number of favorable minus 
unfavorable mentions), and the frequency of the Rorschach 
check-list entry in question. Fifty-one hypotheses were tested 
in this manner. 

This procedure is open to many criticisms. In the first place, 
analysis of scores one at a time violates the Rorschach maxim 
that each score must be interpreted in relation to the total pat- 
tern of the subject. One hypothesis set up was that subjects 
who were lacking FC would be rated ‘cold and unmoved, under- 
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controls emotions.’ But some people scored FC — by Munroe’s 
method are high in CF, whereas others who lack FC lack all 
color and are indeed ‘cold’ personalities. At best, the analysis 
presented here shows the extent to which single Rorschach check- 
list entries may be interpreted, and does not provide a basis for 
judging the validity of a clinician’s interpretation of an entire 
record. If some hypotheses were tried which, on the basis of 
‘second guessing,’ appear to have been unreasonable, it may be 
pointed out that the significance test employed does not penalize 
us for trying a large number of improbable hypotheses. The 
significance test employed introduces a penalty which lowers 
significance only when the results turn out to be directly opposite 
to the relationship hypothesized. Another serious difficulty is 
the extreme unreliability of tetrachoric correlations, especially 
when one variable is dichotomized so that a small proportion of 
the cases fall in one marginal total. No single correlation 
reported for this sample of seventy-two cases can be considered a 
precise expression of a relationship. Finally, one may question 
whether dichotomizing the check-list entries and the reputation- 
questionnaire entries is entirely satisfactory. On the trait 
‘show off-vs.-shy,’ it might have been better to divide the cases 
into three groups, since some subjects showed neither of the polar 
traits. Among Rorschach scores, it might have been better to 
separate the subjects into three groups such as M—, M normal, 
M+, rather than dichotomizing. Too few cases were available 
for this type of analysis with our data. 

We explored the possibility that different relationships between 
questionnaire items and Rorschach would be found for men and 
women, considered separately. Some differences were found, 
but the number of cases available to us are too small for our 
results to be worth reporting in detail. 

Table IV reports all correlations investigated between Ror- 
schach signs and reputation reports. Many correlations fell 
below the arbitrary critical limit of .20. Some of these failures 
to find relations are a contradiction of Rorschach theory. People 
with absence of Fc or with excessive F would be expected to make 
others uncomfortable; those with emphasis on W are presumed 
ordinarily to be interested in the abstract and theoretical. Dis- 
regarding two relationships where the direction of relation had 
not been postulated before studying the data, there were nine- 
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teen correlations greater than .20. Of the nineteen, twelve 
were in the direction anticipated, and seven were in the direction 
opposite to the hypothesis based on Rorschach theory. This is 
not a significant departure from the null hypothesis that fifty 
per cent of the correlations would fall in the predicted direction. 
(The standard error of a p of 50, for nineteen events, is .11). 
This analysis therefore failed to confirm the validity of inferences 
regarding traits from single Rorschach check-list entries. Many 
explanations can be advanced: the unreliability of single entries 
and the criterion, differences in the use of such words as ‘mature’ 
by student raters and Rorschach interpreters, etc. Even after 
these attempts to rationalize the findings, paradoxes remain. 
Why, for example, should those with fewest S responses be those 
who ‘always have something to gripe about’? Why should 
those who ‘make people feel comfortable’ not be distinguishable 
on the basis of the major Rorschach signs from those who ‘make 
people uncomfortable’? 

Some of the relationships are large enough to suggest cor- 
respondence between Rorschach signs and social traits. More 
thorough studies using the reputation technique in well-knit 
groups might yield considerable information on the relation 
between overt behavior and personality structure. 


SUMMARY AND DISCUSSION 


The Group Rorschach records of two hundred students in 
the College of the University of Chicago were compared with 
grades earned, ACE scores, and criteria of social adjustment. 
The results were as follows: 

1) Munroe check-list scores of first-year students correlated 
.17 with average grade on highly reliable and impartial compre- 
hensive examinations. A subjective rating of adjustment as 
shown in Rorschach performance correlated .25 with grades. 
Neither of these correlations is high enough to enhance a multi- 
ple correlation at Chicago. Correlations for students in the 
second- to fourth-year classes were close to zero. A breakdown 
showing the interaction of Rorschach and ACE scores suggests 
that good adjustment may in part compensate for low academic 
aptitude, but this finding is based on too few cases to be accepted 
with confidence. 

2) No statistically significant relationship could be found 
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between underachievement (grade average with ACE held con- 
stant) and any single Rorschach indicator. 

3) Few single Rorschach indicators showed any degree of cor- 
respondence with total ACE score. None of the relationships 
was statistically significant, although some of them are in agree- 
ment with findings of previous studies. 

4) These data do not confirm Munroe’s finding of different 
Rorschach patterns for students with L higher than Q and those 
with Q higher than L on the ACE. No significant difference 
could be found. 

5) Heads of dormitory units rated students on emotional 
adjustment. This rating correlated .31 with Rorschach adjust- 
ment rating. This is a significant departure from chance. 

6) Sociometric descriptions of adjustment were obtained by 
having residents in the dormitory fill out a reputation question- 
naire. The total rating of adjustment from this report cor- 
related about .20 with Rorschach adjustment rating. This 
correlation is statistically significant. 

7) A large number of specific hypotheses were tested, based on 
the presumed correspondence of single Rorschach check-list 
entries with traits described in the reputation questionnaire. 
The hypotheses based on Rorschach theory were confirmed 
slightly more often than they were positively contradicted, but a 
large number of expected relationships failed to materialize. 
The net confirmation of Rorschach hypotheses was not sig- 
nificantly better than chance expectation. 

There can be little difference of opinion about the negative 
character of these findings. In the sample studied, the Group 
Rorschach, objectively scored, failed to predict scholastic success 
and gave only small correlations with criteria of social and 
emotional adjustment. Use of the Inspection Technique with 
the Group Rorschach for purposes of guidance in the College at 
the University of Chicago is not warranted by these findings. 

This study does not substantiate the claims made for objective 
treatment of the Group Rorschach. The only appreciable 
correlations found are those relating the Group Rorschach to 
dormitory ratings. And correlations of the magnitude of .30 
with such criteria can be obtained even with conventional 
questionnaires like the Bernreuter. The only published evi- 
dence, gathered under sufficiently controlled conditions and 
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treated with acceptable procedures, which favors the Group 
Rorschach as a screening and prediction device in college is that 
from Sarah Lawrence. The differences between Sarah Lawrence 
and the University of Chicago are so great that the contradiction 
between the two studies may be explained on many grounds. 
Perhaps ‘personality’ influences grades at Sarah Lawrence, but 
does not affect the comprehensives at Chicago. Perhaps Munroe 
has such superior insight that her scoring of the Rorschach is a 
good predictor of grades whereas the Chicago scorers were not . 
able to assign such valid ratings (but this suggestion is incom- 
patible with the view that the Inspection Technique is an objec- 
tive procedure.) Perhaps the selection of the Chicago group, 
or the different curriculum, accounts for lower correlations 
there. 

This study emphasizes the futility of quick and easy hypotheses 
as to the meaning of Rorschach performance. One cannot look 
at a simple ratio like W: M and infer that the student will or will 
not perform as well as his ACE scores promise. If such a sign 
has any meaning, it has meaning only when the interpreter takes 
into consideration the age, sex, and level of intellect of the sub- 
ject. Hypotheses that may be true for the average patient, or 
the average college freshman, must not be applied to very superior 
students until they have been carefully validated on such a group. 
Even such plausible conjectures as that students with emotional 
disturbance will make poor use of their ability, are too simple to 
do justice to the true operation of personality structure. In one 
student, severe maladjustment may be a factor causing him to 
concentrate and earn high grades, whereas equally severe malad- 
justment of a different character may impede the work of another 
student. Clinical study of Rorschach protocols may con- 
ceivably reveal such interactions. Even if the test is not useful 
as a statistical predictor, it may help the psychologically-trained 
counselor to guide students. 

Further research with the Group Rorschach is recommended, 
particularly since the literature is still devoid of controlled studies 
on adequate samples in typical college programs. It is urged 
that such studies inquire what elements or patterns in the 
Rorschach are associated with particular behaviors and criteria, 
rather than attempting blind prediction of marks or over-all 


ratings. 
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I 


Any investigator embarking on a survey of the extensive pro- 
fessional literature in the field of group remediation, cannot fail 
to note a striking lack of adequate validation data, particularly 
at the college level. A number of reports of experimental course 
findings may be uncovered in the several journals, but the stand- 
ards of comparison used when remedial work is evaluated are, 
more often than not, specious, ill-considered, or clearly super- 
ficial. This is peculiarly true in the field of remedial reading. <A 
review of nearly one hundred studies, for example, uncovers less 
than a dozen references to the effect of reading programs upon 
scholastic improvement. Of these only one study using control 
groups reports apparently significant gains in terms of academic 
grades for reading classes.’ Other investigators either report no 
significant improvement in academic standing as the result of 
remedial instruction, or without definitive findings take the 
hopeful and confident stand that reading instruction can improve 
academic work. 

This startling—and at the same time rather depressing—state 
of affairs poses a basic question for educators and research work- 
ers interested in college remedial reading. It would appear, even 
at this late stage of the game, that the effectiveness of reading 
programs is still largely suspect. Why is it that reading experts 
have bypassed what is seemingly a primary criterion for the 
evaluation of remedial instruction? Academic performance is 
clearly the sine qua non for the validation of remedial courses, 
particularly in liberal arts curricula where by far the largest por- 
tion of the scholastic agenda comprises reading or related activi- 
ties. And in the final analysis remedial instruction must 
necessarily stand or fall on the basis of this single criterion, how- 
ever ingeniously alternative standards of comparison are defended. 

83 
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In speculating about the reasons for this consistent defection 
the tentative explanations which come to mind, plausible though 
they be, do not disguise the fact that remedial teachers (or, more 
properly, those people who concern themselves with the develop- 
ment of techniques and programs) avoid meeting the issue squarely 
when they skirt the problem of relating results to the well-defined 
life situation in which they operate, or concern themselves with 
other less meaningful values. It is certainly true, for example, 
that a simple demonstration of increased academic effectiveness as 
a result of group remedial instruction is not easy to arrange; under 
certain circumstances it may be well-nigh impossible. Most 
remedial reading courses carry no academic credit, and are of 
relatively brief duration. It may be that instructors are hesitant 
in their own convictions that a classroom learning experience of 
less, generally, than twenty-five class hours can have an observa- 
ble effect upon overall academic performance, and so beg the 
issue by emphasizing simple gains in reading speed, increase 
reported in outside or non-academic reading, and the like. This 
in fact is an ostrich-like behavior which has had an inevitably 
unwholesome effect upon the development of worth-while 
remedial techniques. 

It is the usual experience in group reading instruction that 
marked and statistically significant gains in reading speed do 
occur, whatever methods or techniques are applied. With his 
professional equanimity thus assured, the reading instructor may 
be loath to adventure into more indicative areas where less 
gratifying results would undermine the status and acceptability 
of the program. In certain environments this may conceivably 
be a practical and immediate consideration; in a broad view it is 
obviously short-sighted and deceptive. The fact is that the 
improvement of reading comprehension and the development of 
basic organizational skills are the core of the challenge which is 
posed to the remedial specialist. These abilities are complex 
skills which are accepted as being more closely related to basic 
intellectual endowment than the ability to read rapidly; accord- 
ingly, they are more difficult to revamp. Yet improved they 
must be, and with a demonstration that is convincing and 
stripped of idle embellishment. 

It seems reasonable to wonder whether remedial teachers at 
the college level have an appropriate frame of reference for their 
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work. Is the heart of the reading problem actually being 
approached? Are inadequate instructional methods being 
masked with a superficial show of improvement which is always 
conveniently at hand? Are the réles of mechanical instruments 
and techniques being overplayed? Many remedial devices have 
a positive value—though their virtues are neither cardinal nor 
unlimited—and they are almost invariably effective for sustaining 
interest and motivation. Yet one suspects that because of their 
sheer and convincing mechanical facility, reading devices in the 
hands of some instructors are invested with the large burden of 
responsibility for reading improvement, and become an end in 
themselves rather than a limited accessory or handmaiden in the 
basic problems of reading improvement. 

As for currently available remedial texts at the college level, no 
particular professional acuity is required to penetrate the super- 
ficiality of the types of exercises and treatments which charac- 
terize most of these volumes. The shallowness and malfunction- 
ing of college reading programs at large is reflected (and at the 
same time reinforced) by the patent over-concern for a simple 
increase in reading speed, by the plethora of timed selections for 
the measurement of speed with no more than a passing regard for 
well-grounded index of comprehension, by the relative absence of 
working materials to develop basic organizational skills, and by 
the fetish usually made of a ‘high level of interest,’ which has 
produced a spate of materials and workbooks on a level of diffi- 
culty utterly impertinent to the task at hand. The continued 
demand of college educators for sound remedial work is made 
clear by the interest and support given the corrective programs 
which do exist; the fallibility of the programs themselves is 
reflected unhappily in the potboiling welter of generally inconse- 
quential writing which decorates the bookshelves of remedial 
specialists and instructors. Put differently, there is some doubt 
as to whether the contemporary mass of study aids, workbooks, 
and corrective pamphlets in this area is really related to the prob- 
lem of improving reading skills at the college level. 

As a collective result of these elements, the status of group 
remediation in college continues to be unhealthy. Remedial 
work is still peripheral; remedial measures (and remedial special- 
ists) are still under some suspicion. Integration of reading pro- 
grams with the curriculum is tenuous if attempted at all. Stu- 
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dents with reading difficulties are taught how to improve their 
scores on standardized reading tests, but are assisted to a far 
lesser extent in their basic problem of academic adjustment. 
Faculty codperation leaves much to be desired, although some 
recognition and tongue-in-cheek acceptance is given in many 
universities. And the reading programs themselves to varying 
degrees are lacking in vitality, force, pertinence, direction. 
Why? Basically the reason is that remedial programs have not 
conclusively demonstrated their worth. In the eyes of educators 
at large this situation not only casts a mantle of doubt over the 
field of reading and the educational psychologists who are working 
in it, but as a matter of course it also has a systematically bad 
effect upon the life forces of remedial research. For it is of the 
nature of things that patent sterility in any educational field 
attracts neither the most capable of research workers nor the 
most effective and interested of instructors. 

In gauging the value of their class work, remedial reading 
instructors in the past two decades have gone through a kind of 
developmental scale which may be sharply criticized at every 
stage. The first type of evaluation involved the simple and 
informal subjective appraisal of result by either teacher or stu- 
dent, or both. However indefensible this procedure from the 
standpoint of research accuracy, there is a deal of undeniable 
value in the sense that student and teacher were reasonably 
united in purpose. In verbalizing subjective reactions to a com- 
mon experience—participation in a remedial class—the parties 
involved were compelled to express a frame of reference. And if 
points of view differed, they emerged and were immediately 
recognized—a condition by no means characteristic of more 
‘refined’ evaluations. 

A second step in appraising the results of remedial work was 
the classical and overworked test method, wherein alternate 
equated forms of a standardized reading test were administered 
before and after the training period. Standardized and objec- 
tive reading tests with equated forms exist in large quantities, 
and test-retest results show statistically significant gains with 
gratifying regularity. This approach is useful only to the extent 
that a reading index or test score is a valid measure of the com- 
plexity of reading skills which a college student needs for a suc- 
cessful academic adjustment—a highly dubious assumption. 
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Actually, this type of appraisal does no more than demonstrate 
that remedial techniques may effect appreciable gains in ‘reading 
test performance.’ Aside from the basic artificiality of the pro- 
cedure, there is a real danger that the organization of reading 
course materials will be directed to a perverted end, the improve- 
ment of reading test scores. Not only is the desirability of a 
meaningful transfer of acquired skills to an academic situation lost 
sight of, but in addition an insidious concept may be implanted 
in the mind of the participating student, who tends to acquire a 
false system of values with respect to his own reading abilities 
and skills. 

A third stage of evaluation sets a comparison between groups 
of individuals given remedial training and comparable unexposed 
groups, in terms of standard tests or other measures. The intro- 
duction of so-called control groups is an artful salaam to scientific 
method, but at bottom this process is as unreal as either of the 
foregoing. It must be noted, however, that a leveling and 
leavening influence here does take place, since it is a common 
experience that the ‘control’ groups, given no remedial training, 
often show considerable gains—though not as great as those of 
the remedial groups themselves. The simple passage of academic 
time (or, more properly, the accumulation of certain environ- 
mental skills) appears to account for some ‘improvement’ on the 
basis of reading test-retest results. And, of course, for the 
thoughtful and conscientious remedial specialist the real question 
remains: Do reading tests measure the sort of thing he is attempt- 
ing to improve? 

Apparently the last step in the appraisal of reading courses 
(and this touched upon with unbecoming lightness in the litera- 
ture) is the comparison of reading groups with suitably controlled 
non-participants, on the basis of academic performance. In these 
studies, reading class members are generally matched with other 
students for reading skill (test scores) and a measure of intellec- 
tual capacity. A comparison is then drawn between the two 
groups, in terms either of over-all scholastic performance or a 
suitable derivative (average grades in courses requiring heavy 
reading assignments, for example). With exceedingly rare 
exceptions these studies do not result in unequivocal conclusions. 
Differences between groups occur, and most often in favor of the 
remedial classes, but they cannot be defended on statistical 
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grounds. This fact of itself may in part account for the infre- 
quency of this kind of observation. 

Of the approaches which have been briefly noted here, the last 
appears to be the most defensible. The standard of comparison 
is meaningful and real both for instructor and student; goals of 
instruction are necessarily well-defined in terms having an intense 
and practical value for an academic life-situation—so obliging 
the instructor to discard irrelevancies in organizing his material; 
the pitfalls intrinsic to the use of tests are avoided. All this 
notwithstanding, there appears to be one all-important objection 
to this evaluative approach. The unsound assumption is made 
that requirements of experimental control are satisfied if initial 
reading performance and intellectual capacity are held constant. 
That is to say, the proposition is made that there are no other 
important qualities which may distinguish students in remedial 
courses from those who do not participate. Initial attitudes and 
motivations are entirely disregarded; a singular omission and one 
which becomes all the more striking when it is remembered that 
most remedial classes are conducted on a voluntary basis, or at 
best have only partial academic credit. When students choose 
freely to present themselves for remediation, or are allowed a 
degree of choice in selection, the function of personality factors 
cannot in reason be denied. With a certain logic one could 
theorize, for example, that under those conditions reading course 
registrants might be overweighted with highly motivated indi- 
viduals—the undergraduate ‘eager beavers’—whose eventual 
performance gain would be associated, at least in part, with the 
qualities and traits which caused the selection of the course in the 


first place. 


II 


Why do students present themselves for remedial help? To 
throw some light on this question an informal survey was under- 
taken in the spring of 1948 at the Department of Psychiatry and 
Mental Hygiene, Yale University, where a remedial reading pro- 
gram for undergraduates has been developed. The subjects 
comprised sixty freshmen in Yale College, a random sample of a 
larger group who had participated in reading classes during either 
their first or second semesters. The procedures were simple and 
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straightforward, including the group administration of a brief 
questionnaire designed for the purpose, and a half-hour indi- 
vidual clinical interview. The stated goal of this exploratory 
survey was to determine as accurately as possible the motiva- 
tional patterns causative to ‘voluntary’ participation in remedial 
classes. Results were to a degree equivocal, and since the find- 
ings are subsidiary to the main issue of this note, a complete 
analysis will not be presented. Nonetheless, simply by way of 
illustrating the apparent complexity of student attitude facing 
the remedial teacher, there follows a brief summation: 

For each of the sixty men seen, it was possible (by an objective 
tabulation of questionnaire responses and an evaluation of inter- 
view material) to assign a main determinant for the initial atti- 
tude toward remedial instruction. By no means entirely justi- 
fiable, this procedure tended to oversimplify the expressions, 
since often a primary attitude was seen to be contaminated or 
qualified by lesser dispositions. However, a substantial reliabil- 
ity was obtained in so rating these data for the principal attitude 
factor. Independent judgments made by two clinicians of both 
questionnaire responses and transcribed interview material 
resulted in perfect agreement in the selection of appropriate 
categories, and a percentage agreement of .93 in assigning sub- 
jects to the chosen categories (disagreements being referred to a 
third rater and a consensus obtained). It should be remembered 
that these students had given original lip service to the voluntary 
and non-academic character of the remedial instruction. In a 
word, they had presented themselves as aware of certain reading 
deficiencies and desiring improvement. Accordingly, the atti- 
tudes recalled as important at that time might be considered 
substitutive, although in terms of motivation value—and con- 
comitant pedagogic challenge—they have been adjudged of pri- 
mary significance. The expressions of these subjects may be 
assigned to six general categories. 

1) For twenty-five individuals (little more than forty per cent 
of the group), the main reason for seeking remedial instruction 
appeared to be a knowledge of a reading disability and a sincere 
desire to improve scholastic efficiency through remedial work. 
In none of these cases was motivation markedly contaminated by 
other issues or values; these men were freely attempting to 
improve their reading skills, uninvolved with social and emotional 
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pressures about this step, relatively unconcerned with the self- 
devaluating judgments implied by their decisions. 

2) In the case of fourteen students the primary reason for par- 
ticipation was a coercion (or a strong suggestion) on the part of a 
dean, a student counselor, or a faculty member. Although their 
reading deficiencies were clearly demonstrable, these men were 
without exception initially resistive to the idea of joining a special 
class and did so only to satisfy an official injunction. 

3) For eight students, the reading course appeared to repre- 
sent their last chance to remedy a variety of language difficulties 
which had been unsuccessfully dealt with—in all cases through 
individual work—prior to coming to Yale. These subjects were 
handicapped by speech defects, or specific spelling disabilities, or 
deficiencies in English usage, and while aware of the specific 
instructional goals, hopefully looked upon the course as being 
vaguely related to their own problems of language. 

4) Declaration of candidacy for the remedial classes was, for 
six students, admitted to be an overt and conscious avoidance of 
certain demands which the university environment had made 
upon them, and which—in each case because of emotional or 
personality problems—they felt unable to meet. In effect the 
remedial work was the lesser of evils, a substitute activity. 
Thus, one student had been able briefly to extricate himself from 
compulsory physical training; another had parried a parental 
pressure to take part in the activities of a student-sponsored 
social service organization; still another was attempting to ward 
off the stigma of a fraternity rejection by methodically entering 
all available campus activities, academic or otherwise. 

5) In a somewhat different way than the foregoing, the par- 
ticipation of four students appeared to relate directly to their 
inadequate and immature adjustment to the social and emotional 
requirements of a university atmosphere. They felt no specific 
anxiety or need; rather, an undifferentiated and diffuse concern 
for themselves and their work. Not markedly deficient in read- 
ing skills, they were ‘joiners,’ uncomfortable and inept, interested 
not so much in prestige values as in being occupied, in this case in 
a situation which offered a possible academic reward. 

6) Lastly, the groupings above were not suited to three men, 
whose decision to take the reading course was for each a function 
of a basic personality’ maladjustment, and who were eventually 
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seen at the Division of Psychiatry and Mental Hygiene as clinical 
cases. 

If they do no more, these observations serve to illuminate the 
source of some instructional problems in remedial work which are 
usually given little consideration in the evaluation of course 
results. They must in some way be treated if a realistic appraisal 
of remedial instruction is to be made. 

It is noteworthy that with this representative sample of volun- 
teer remedial subjects, less than half was of an initial persuasion 
which would make for productive and efficient teaching. This 
note is intended to suggest that the methods most often used to 
evaluate college remedial work are indefensible to greater or 
lesser degrees, and that any reasonable appraisal must take into 
account the attitudes and motivations of the participating stu- 
dents. One possible approach to the problem of motivation con- 
trol is herewith offered in a brief account of a study conducted at 
Yale University. 


III 


An appraisal in terms of academic performance was made of 
remedial classes in reading conducted during the fall semester of 
1948. The control group comprised a number of students who 
originally presented themselves as candidates for participation 
and who were unable to do so through force of circumstance. 

As is the usual practise, a brief battery of reading tests was 
offered to all entering freshmen at the beginning of the term. 
Results were reported to all men, and an announcement of the 
offering of a remedial course (to carry no academic credit) was 
sent to those individuals whose reading speed and comprehension 
scores fell below the 20th percentile. At the organization meet- 
ing of the course approximately one hundred sixty students 
appeared to fill out a preliminary questionnaire pertaining to 
instruction, course detail, and sectioning. In view of the instruc- 
tional load it was necessary to limit sections and to arrange course 
meetings arbitrarily. Of the men who wished to register, sixty 
were at that time unable to take part because of conflicting 
academic schedules or previous athletic commitments. The 
motivation toward the remedial work of those individuals who 
presented themselves as candidates and were in effect rejected, is 
held to be at least roughly equivalent to the introductory motiva- 
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tion of actual participants. Thus, if possible differences of 
intellectual ability and reading skill may be controlled, these two 
groups offer an appropriate means of gauging the effect of 
remedial instruction on academic performance. The motivation 
of the non-participants is, of course, under some suspicion; seem- 
ingly these men might have undertaken to transfer to other 
section meetings of academic courses, or to sacrifice a part of their 
athletic activity, in order to gain admittance. That their 
interest in the remedial course was somewhat more than transient, 
however, is attested by the fact that in a later semester forty- 
three of these students (seventy-two per cent of the group) 
registered for the work. 

An initial comparison of participants and non-participants in 
terms of two reading test results, a rough measure of intelligence, 
and a combined index of college aptitude and secondary achieve- 
ment, shows no marked group differences. Table I presents the 
mean scores for a measure of reading speed (words read per 
minute), a measure of reading comprehension, a general academic 
prediction, and the Verbal Section of the College Board Scholastic 
Aptitude Test (SAT).* Contrived as an index of verbal com- 
prehension, the latter instrument is comparable to an index of 
(verbal) intelligence, and is often used as such for purposes of 
general classification. 

The academic prediction scores are forecasts of average grade 
performance, and are derived both from the C.E.E.B. battery 
results and a suitably weighted secondary school grade average. 
Since as entering freshmen these subjects have no initial college 
grade standing, these predictions—combining academic aptitude 
and previous achievement—are particularly suitable as a stand- 
ard of comparison. 

The t values for these four measures show no significant dis- 





* Most of the well-known group reading tests have been abandoned at 
Yale, since the larger part of the population tends to array itself near the 
upper end of the scale, making practical discriminations difficult. The 
reading tests used in this instance were two long excerpts (3000 words) 
from basic history and psychology texts. Twenty questions of a multiple- 
choice type were devised for each selection, and these tests, scored both for 
speed and comprehension, produced more satisfactory distributions than 
published standardized instruments. The Scholastic Aptitude Test scores, 
as a part of the regular C.E.E.B. battery, were conveniently available for 
each subject, as were also the academic predictions. 
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TaBLE I.—Group CHARACTERISTICS; FouR MEASURES 





Remedial Non-Partici- 
Participants pants 
(N = 102) (N = 60) t p% 




















M o M o 

Reading Speed 

(Words per 

Minute) 230 55.1 | 238 48.1 .94 | 30-40 
Reading Com- 

prehension 13.6} 3.0| 138.2] 3.1 .81 | 40-50 
SAT 538 27 529 28 .46 | 60-70 
Academic 

Prediction 71.3 | 6.3 | 72.5 | 7.0] 1.17 | 20-30 











tinctions between the two groups. Differences which do exist 
may be attributed either to numerically inadequate sampling or— 
as is more likely—to some real motivational disparity. The 
closest approach to a statistically defensible difference is observed 
with the academic predictions, where an index between the 20 and 
30 per cent confidence levels appears. Since these predictions 
are in part based upon a long-term scholastic performance, they 
are more likely to reflect motivation forces than the other three 
measures, derived from relatively brief test situations. It is 
interesting to note that the non-participant control group sur- 
passes the remedial class members in two of the four measures. 
The control group displays a somewhat more rapid speed of 
reading, together with a slightly lower level of comprehension, 
than the experimental group. The mean aptitude test score is a 
little higher for the reading participants, who are at the same 
time assigned a somewhat lower average academic prediction. 
The combined significance of these latter two observations is that 
of a better secondary school achievement on the part of the con- 
trol group. 

In each case the SAT mean is well above the general college 
average of 500 on this scale, and somewhat below the Yale aver- 
age of 550. Accordingly, this study centers upon a population 
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average or high average in academic aptitude (unlike the burden 
of reading experiments reported in the literature, which have 
dealt with below-average groups). Reading speed and compre- 
hension scores for both groups approximate the 25th percentile 
level for Yale freshmen populations. 

The experimental group, disjoined into three sections of 
approximately equal size, was given twenty-one classroom hours 
of remedial instruction. The training period extended over ten 
weeks, and was completed shortly before the end of the half-year 
semester. Scholastic records for this academic period were col- 
lected and comparisons drawn between the remedial group and 
the non-participants. The two groups are contrasted in three 


TaBLE II.—A COMPARISON OF ACADEMIC PERFORMANCE: 
REMEDIAL STUDENTS AND CONTROLS 























Remedial | Non-Parti- 
Participants} cipants 
icip ip : D% 
M o M o 
Total grade Average | 72.4 | 7.1 | 70.8 | 7.3 | 1.4 | 10-20 
Verbal Courses 73.0 | 7.3 | 71.2 | 6.8 | 1.6 | 10-20 
Residual Courses 71.9 | 6.7 | 70.7 | 7.6 | 1.1 | 20-30 











ways; in terms of over-all grade averages, performance in courses 
of an essentially verbal nature, and performance in the residuum 
of courses (largely scientific or quantitative). The so-called 
verbal courses were arbitrarily selected to include those areas of 
instruction in which reading skills seem basic to scholastic suc- 
cess. The results of language courses (elementary or first-year 
classes excluded), and grades in Economics, English, Classical 
Civilization, History and other social science courses were com- 
bined to a verbal average. The remaining grades—heavily 
laden with science course results but including all elementary 
language—were also averaged. These data, with the t values, 
are presented in Table IT. 

By no means an unimpeachable proof of remedial effectiveness, 
the results are nevertheless encouraging in view of the initial pre- 
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diction that the control group would to some extent surpass the 
remedial students academically. The scholastic differences 
shown are in favor of the remedial group and, in the case of verbal 
course averages, the distinction verges closely on the 10 per cent 
level of confidence. To this extent participation is meaningfully 
associated with a higher academic efficiency. The least signifi- 
cant difference between the two groups appears, as might be 
expected, with performance in nonverbal subjects. 

Inasmuch as these groups were originally seen, with the meas- 
ures used, to be no more than roughly equivalent, the academic 
gain shown by the remedial students might be disputed. Accord- 
ingly a review of scholastic performance was also made in terms 
of carefully matched pairs of subjects. This procedure makes 
for an unavoidable sacrifice of population, but yields a near-per- 
fect equivalence between a control and an experimental group. 
As many remedial students as possible were paired with non- 
participants on the basis of decile scores for the two reading 
measures and SAT results, and a three-point interval for the 
academic predictions. (In the latter case this arbitrary matching 
criterion was considered necessary because of the initial predic- 
tion disparity between the groups.) 

Application of these standards furnished thirty-one matched 
pairs of subjects. Conformation between control and experi- 
mental groups is satisfactory; the t values for all four measures 
are smaller than .25 (less than an 80 per cent confidence level). 

An examination of semester academic averages for these pairs 
of students shows a mean difference, in favor of the remedial 
group, on the order of a 10 per cent significance (t = 1.7). 
Further scrutiny of paired differences in terms of verbal and 
quantitative course performance discloses very similar distinc- 
tions. These results appear to buttress the observations made 
with the larger populations. To the degree that the motivations 
of the two groups for remedial instruction are comparable, the 
average gain of the remedial students is at least suggestive of a 
real academic utility. 


SUMMARY 


1) A review of current remedial practises at the college level 
reveals consistent shortcomings with respect to the validation of 
techniques. Academic criteria have been generally disregarded 
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in the evaluation of remedial work, and other methods, facile but 
less relevant, employed to demonstrate supposed improvement. 
Motivational factors involved in the student selection of remedial 
course work have been completely neglected in appraisals found 
in the literature. It is suggested that the unreal approaches to 
validation taken by remedial specialists have contributed in large 
part to the still ambiguous and ill-defined professional status of 
the field as a whole. 

2) Results of a combined questionnaire-and-interview survey 
of student attitude toward a non-credit and volunteer course in 
remedial reading are reported. Initial motivation for the work 
ranged widely. Less than half of the group investigated dis- 
played original motivation which was considered instructionally 
advantageous; the majority of students participated either 
through coercion or as a means of avoiding certain environmental 
demands. 

3) In an evaluation of a classroom remedial program by means 
of scholastic performance, an attempt was made to take into 
account the initial motivation of participating subjects. Follow- 
ing the training period the remedial students showed average 
academic gains approaching significance over the control group. 
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TRUANCY AND CLASSROOM DISORDER 
AS SYMPTOMS OF PERSONALITY PROBLEMS! 


FRANCES A. MULLEN? 
Director, Bureau of Mentally Handicapped Children, Chicago Public Schools 


It is axiomatic in educational philosophy that the child who 
resorts to truancy from school or to disorderly behavior when in 
school does so because he is unhappy and unsuccessful in school. 
The reasons why he is unhappy and unsuccessful may be sought in 
his physical condition and history, in his innate mental capacities, 
in his home and community environment, or in the curriculum, 
teaching practices, and environment of his school. Any factor 
from one of these areas may be sufficient to produce a problem 
symptom; more likely several factors from several of the areas will 
be found to contribute to a particular child’s behavior pattern. 

Granting these premises, the major questions to be raised by 
this paper are these: Are the children who turn to truancy as a 
solution for their problems different from those who choose class- 
room disorder? What physical, educational, personal, and 
social factors appear to be more closely associated with truancy 
and which with disorderly behavior? Do these symptoms have 
a different constellation of associated factors for the adolescent 
child than for the pre-adolescent child? 

The data for this study were compiled from the records of indi- 
vidual examinations of 1628 children, selected from the total of 
16,944 records of individual examinations made by psychologists 
and psychiatrists of the Bureau of Child Study of the Chicago 
Board of Education in the calendar years 1945 and 1946.* To 
understand certain biases in the present data it is necessary to 
know more about the larger sample from which the 1628 cases 


were drawn. 
In 1945 the staff of the Bureau administered 8262 individual 


1 Paper read at Midwestern Psychological Association convention, 
St. Paul, Minnesota, May 7, 1948. 

Formerly psychologist, Bureau of Child Study, Board of Education, 
Chicago. 

* Munson, Grace. Bureau of Child Study and the Chicago Plan of Adjust- 
ment Service. Chicago: Board of Education, 1947, pp. 52. Contains a 
brief description of the work of the Bureau and the nature of the exami- 
nations conducted. 
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examinations (not counting diagnostic reading examinations), 
and in 1946, 8679.! The subjects ranged from nursery school to 
college, with intelligence quotients from below 20 to above 200. 
Because no child may be placed in an ungraded division, or 
excused from school for mental immaturity, without the recom- 
mendation of the Bureau of Child Study, a large number of cases 
are referred to the Bureau because the school personnel believe it 
likely that the child is below average in intelligence. However, 
with the expansion of the staff and services of the Bureau in the 
past twelve years, such cases no longer predominate. Children 
are referred for every variety of school problem, including guid- 
ance of extremely gifted children, and sometimes at the request 
of parents or social agencies when no school problem has been 
apparent. This changed emphasis in the work of the Bureau is 
reflected in the increase of the mean intelligence quotient of those 
tested from 78 in 1937 to 88 in 1946. Boys have consistently 
predominated over girls in the ratio of about seven to three. 
About one-fourth of all cases in 1945 and 1946 were non-white. 
The present sample of 1628 cases includes children from well over 
half of the three hundred seventy-nine elementary and high 
schools of the public school system. Examinations by a large 
proportion of the seventy staff members are included. 

A Bureau of Child Study examination usually includes an indi- 
vidual mental test, educational achievement tests, physical tests 
and observations, interviews with parents, school personnel, 
social agencies, truant officers, physicians and clinics, and others. 
Cases are cleared through the Social Service Exchange to deter- 
mine all agencies which have had contact with the family. After 
an examination has been completed, the recommendations made, 
and the report written, many of the facts concerning the educa- 
tional, physical, social, and family history and condition of the 
child are coded according to a definite numerical system? by the 
psychologist. Then an IBM punched card is prepared for each 
child, giving the numerical results of mental and educational 
tests, and the coded data on other factors. 

For the present study, the punched card records of all examina- 





1 Statistical Report of Services of Bureau of Child Study, 1937-1946, 


Mimeographed. pp. 53. 
* Revised Code for Child Study Record, January, 1945, Mimeographed. 


pp. 12. 
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tions made in 1945 and 1946 were sorted. The records of all 
children of ages nine to sixteen inclusive who were coded as having 
histories of truancy but were not conspicuously disorderly in clags 
were placed in the ‘truant’ group, while the records of all chil- 
dren of the same ages who were considered notably disorderly but 
not truant formed the group labeled ‘discipline problem in the 
classroom.’ Each group was subdivided into a group aged nine 
to twelve inclusive hereafter called the ‘pre-adolescent’ group 
and a group of thirteen- to sixteen-year-olds, hereafter called the 
‘adolescent’ group. Obviously this is an extremely loose use of 
the term ‘adolescent,’ employed here for economy of expression 
in referring to the two groups, as probably descriptive of a 
majority, though not all, within the group. 

In the statistics which follow, these four groups: the pre- 
adolescent truants, pre-adolescent discipline problems, adolescent 
truants, and adolescent discipline problems, are compared with 
each other and with the whole range of child study cases for one 
year, 1946. This whole group is, of course, far from a representa- 
tive or random sampling of the school population. It is a group 
of children referred to an agency because they presented some 
type of problem in educational or social guidance. The truants 
and behavior problems here reported also are not necessarily 
representative of all truants or all the disorderly pupils in the 
school system, but only of those of the specified ages who were 
selected for referral to this agency. 


SEX, FAMILY ORIGIN, AND AGE RANGE OF EACH GROUP 


In the total group of all cases studied by the Bureau of Child 
Study in 1946, boys predominate over girls in the ratio of seven 
to three (Table I). In the two pre-adolescent groups here 
selected, they predominate in the ratio of about eighty-nine to 
eleven, suggesting at this age level a lesser tendency for girls to 
present these behavior problems than to present such other prob- 
lems as apparent mental or educational retardation, or other 
causes for referral to a clinic. However in the adolescent groups, 
a very different situation may be noted, especially with reference 
-to the truants. In the thirteen to sixteen age group, almost forty 
per cent of the cases included are girls. This probably reflects an 
actual increase in the incidence of truancy among older girls, but 
also reflects an added awareness on the part of the school per- 
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TABLE ].—DeEscrRIPTIVE Data CONCERNING THE Four GROUPS 
OK CHILDREN STUDIED 




















Pre-adolescent Adolescent 
All 
Discipline Discipline | Children 
_— Problems — Problems Examined 
Nos IN OO | ae eee 
Classroom Classroom | N = 8679 
N = $11 N = 231 
Percentage of girls 
in the group..... 11.2 12.1 39.4 16.0 29.8 
Percentage of non- 
whitesinthegroup| 37.1 28.8 30.4 19.9 23.1 
Mean CA in years 
and months...... 11-3 11-0 14-11 14-6 11-1 
Grade expectancy 
corresponding to 
mean CA........ 6.3 6.0 9.9 9.5 6.1 
Mean MA in years 
and months*..... 10-2 10-1 13-8 13-3 t 
Grade expectancy 
corresponding to 
mean MA....... 5.2 5.1 8.8 8.3 Tt 
Mean actual grade 
placement....... 4.5 4.7 8.8 8.2 4.8 
Mean grade score 
on reading com- 
prehension test{..} 3.4 3.7 6.4 5.7 tT 











* Based on Revised Stanford Binet, Wechsler Bellevue, or other indi- 
vidual mental test. Data not available for eleven to twenty per cent of 
each group. For most of these, mental data from a previous individual 
examination would have been available in the child’s folder. 

t Data not available. 

t Based on standardized reading tests administered by the psychologist. 
Such tests were not administered for from thirteen to thirty per cent of each 
group of cases, usually because recent tests had been given by the school or 
sometimes because the child had no measurable achievements. Inclusion 


of such cases would be more likely to depress than to raise the mean grade 
level. 
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sonnel of the serious social implications frequently associated with 
truancy on the part of girls of this age. An adolescent girl truant 
is perhaps more likely to be referred to the Bureau of Child Study 
than an adolescent boy truant. 

The percentage of non-whites (Table I) is higher in the groups 
selected for study than in the total of all child study cases, with 
the exception of the group of adolescent discipline problems. In 
the other three groups, approximately thirty per cent, or more, 
of each group are non-white, as compared with twenty-three per 
cent of the total group. 

Less than two per cent of the children of any of our groups were 
foreign-born, but a wide variety of ancestral backgrounds are 
indicated. Children of Jewish descent are seldom found in the 
truant groups of this study, but much more often in the discipline 
problem groups. Children of Irish descent are more frequently 
found in the truant group than in the disorderly group. The data 
on the other national stocks do not indicate significant differences 
in the type of behavior symptom developed. 

The ages of the various groups have been only partially con- 
trolled by the method of selection used. Since truancy as a 
school problem increases in prevalence with age, while classroom 
disorder apparently decreases as a significant factor in our series 
of case studies, our pre-adolescent truants have a higher mean 
CA than do the pre-adolescent discipline problems (though both 
were limited strictly to pupils of ages nine to twelve, inclusive). 
The same is true for the two adolescent groups. 


MENTAL DATA 


The mean IQ’s of the four groups (Table II) range from 90.3 
for the pre-adolescent truants to 96.1 for the adolescent truants, 
with all four groups including cases from below 60 to above 
150 IQ. 

Because of the still existing, though lessened, tendency of 
school personnel to refer to the Bureau psychologist chiefly 
children suspected of having IQ’s below 80 (while handling prob- 
lems of brighter children without the psychologist’s assistance) 
these means must not be interpreted as though they were means 
for all the truants or all the discipline problems of the system. 
All four of our problem groups have higher mean IQ’s than the 
whole range of Child Study cases. Certainly the mean IQ of 97 
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TABLE IIJ.—PERCENTAGE DISTRIBUTION OF INTELLIGENCE Quo- 
TIENTS IN Four SELECTED GROUPS OF CHILDREN 























Pre-adolescent Adolescent 

All 

: e Discipline Discipline | Children 

Intelligence Probl Probl etiaiail 

: roblems roblems | Examine 

Quotient Truants ; Truants . ye 
N = 224 in N = 662 in in 1946 
Classroom Classroom | N = 8265* 
N = 5ll N = 231 

peewee... - A wanes pegeeers feeenrnes 2.1 
50 to 59 4 1.6 3 2.2 3.8 
60 to 69 4.0 4.9 5.1 7.4 9.4 
70 to 79 15.2 12.9 10.6 7.4 17.2 
80 to 89 23.7 15.5 18.0 18.6 17.9 
90 to 99 26.3 17.8 18.6 22.1 16.1 
100 to 109 9.8 14.1 17.1 10.4 10.8 
110 to 119 5.4 8.2 12.2 9.1 6.2 
120 to 129 2.7 2.7 4.5 6.1 3.0 
130 to 139 4 1.0 3.3 3.0 1.3 
re 2 8 4 7 
150 or over 4 4 2 4 5 
Not tested t 11.6 20.5 9.5 13.0 11.0 
99.9 100.0 100.1 100.1 100.0 
Mean IQt 91.1 92.7 97.0 94.9 87.8 
8.D. 14.39 17.6 17.9 19.3 20.5 











* Children given audiometric examinations only have been excluded. 
+t For most of these children, intelligence quotients from an earlier indi- 
vidual mental examination would be available in the case folder, but was 


not available on the punched card record. 
t Calculations of means and standard deviations are based on the number 


of children for whom intelligence quotients were available, 


found for our group of adolescent truants strongly suggests that 
a random sample of this classification of child for the whole school 
system would show a mean of 100 or higher. The large per- 
centage of children falling in the 80 to 99 IQ ranges suggests 
the possible hypothesis that many of these children, because of 
their personality disturbances, appeared to their own teachers 
and principals as being likely candidates for an ungraded division 
(below 80 IQ), whereas the psychologist’s examination revealed 
that a dull mentality was not the root of the problem. 
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When mental status is compared on the basis of mental age 
(Table I), it must be remembered that in spite of the narrow range 
of age selection, the truants had higher average chronological 
ages than the discipline problems, within both the pre-adolescent 
and adolescent series. The differences in mean mental ages for 
the two types of behavior symptom are probably not statistically 
significant. 


TRUANCY VERSUS DISORDER IN THE PRE-ADOLESCENT YEARS 


As we survey Table III, we may first list the characteristics 
in which the truants show more serious problems than the 
discipline cases. Children of our younger truant group are more 
apt to come from broken homes than are the discipline cases 
(incidence fifty-two per cent and thirty-one per cent, respec- 
tively). A parent or sibling is known to be delinquent for 8.5 
per cent of the truants and only 1.5 per cent of the discipline 
cases. More of the truants have a step-parent, more are in 
foster homes, and more are from families on relief. Known 
instances of lying or stealing are reported for 11.6 per cent of the 
truants and only 6.5 per cent of the discipline problems. The 
truants have had more checkered school careers in that they have 
changed schools more frequently and have had more periods of 
interrupted attendance, though they have not repeated grades 
any more frequently. 

Second, we may note the characteristics in which the discipline 
cases show more serious problems than the truants, still confining 
our attention to the pre-adolescent series. The classroom disci- 
pline cases appear much more likely to be described as nervous 
and hyperactive, as employing attention-getting devices, as 
showing aggressive, anti-social behavior, and as possessing poor 
work habits. These things are probably partly descriptions of 
what is meant by the classroom disorder. They are very infre- 
quently marked for the children who have records of truancy, 
but are not definite discipline problems in the classroom. A 
larger per cent of the discipline problems than of the truants of 
this age level are described as having unfavorable health his- 
tories, suggesting that the ‘pampered sickly child’ may be found 
in the discipline group more frequently than in the truant group 
or in the whole range of child study cases. Also a larger per 
cent of the discipline problems are the eldest child in their own 
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TABLE III.—PERCENTAGE INCIDENCE OF CERTAIN FACTORS AS 
CITED IN THE CasE Histories OF Four SELECTED GROUPS OF 














CHILDREN 
Pre-adolescent Adolescent all 
Discipline Discipline . 
Problems a Children 
Truants : Truants ; Examined 
N = 224) oy com | N = 662! cipcee in 1946 
assroom Classroom N = 8679 
N = 5ll N = 231 
Educational 
Factors 
Repeated grade or 
grades.......... .| 64.3 60.3 53.0 55.0 36.6 
Varied school ex- 
perience......... 57.6 37.0 40.6 38.5 24.1 
Interrupted attend- 
Ek « wine o's 34.4 20.7 26.7 19.9 16.8 
Unsuitable place- 
ment, now or 
earlier........... 7.6 14.1 5.1 10.4 10.4 
Reading disability..| 26.8 25.4 9.8 20.3 11.3 
Skipped grade or 
grades........... 1.8 2.5 8.8 6.9 2.5 
After school activi- 
I ar see ae: bir 8 3.6 1.2 7.1 6.9 1.0 
More than one year 
over-age for grade 
placements...... 45.5 48.1 35.5 42.4 30.3 
More than one year 
under-age for 
grade placement. 4 2 1.5 4 4 
Physical Factors 
Defective teeth....| 48.7 41.3 43.4 35.5 37.3 
Defective vision....| 29.5 27.8 34.9 29.4 26.9 
Ear, nose, or throat 
condition........| 20.1 16.2 17.8 16.0 16.1 
Speech disturbance.| 5.8 5.9 4.1 6.9 10.9 
Defective hearing. . 4.5 3.1 6.9 5.6 6.4 
Unfavorable health 
SER R ee 4.5 11.0 6.5 6.1 5.7 
Poor nutrition or 
general health... 3.6 5.3 8.6 10.0 4.8 
Behavior and Per- 
sonality Factors | 
Poor work habits...} 14.3 52.5 25.1 51.9 10.6 
Nail-biting or 
thumb-sucking. .. 5.8 8.6 13.1 10.8 7.0 
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TaBLeE III (Continued) 
Pre-adolescent Adolescent 
Discivli Discivli All 
iscipline iscipline | ( HGren 
T Problems Problems . 
ruants ; Truants ; Examined 
N = 224) oy oom | N = 662! ciacer in 1946 
assroom Classroom N = 8679 
N = 5l1l N = 231 
Lack of self-confi- 

EE cls dai ch! 4.5 8.6 19.6 13.4 6.0 
Nervousness, hyper- 

motivity... 0.220. 2.7 18.6 7.6 19.5 5.6 
Social immaturity. . 3.1 5.9 5.9 7.8 5.1 
Aggressive, anti- 

social behavior...| 3.1 27.4 5.0 27.7 3.5 
Attention-getting 

I cy cen wai 4.0 16.9 3.6 19.0 2.4 
Habits of lying or 

stealing......... 11.6 6.5 9.7 4.8 1.9 
Withdrawn, un- 

social nature..... 2.2 2.9 5.6 4.8 1.8 
Temper tantrums. . 1.3 3.3 1.8 6.1 Me 

Position among 

Siblings 
Youngest child..... 24.6 23.0 25.2 25.1 25.3 
Eldest child....... 13.4 22.0 23.7 23.8 21.2 
Only boy among 

girls, or reverse. . 8.5 15.5 15.1 20.8 14.9 
Only child......... 12.5 15.7 10.6 12.1 10.6 
Sibling rivalry..... 2.7 3.8 4.7 9.5 1.4 

Family Factors 
Broken home...... 52.7 31.4 48.5 37.7 24.9 
Foreign language 

used predomi- 

nantly inhome...| 13.4 14.2 11.5 11.7 12.7 
Step-parent in 

home, now or for- 

SS ce cidds w04 15.2 11.5 16.3 13.0 7.2 
Crowded home..... 1.8 10.5 10.0 7.4 7.2 
Unwise parental di- 

Pcc<sasaes 21.0 18.6 27.9 27.7 6.9 
Foster or boarding 

home placement. 9.4 5.4 6.9 6.1 4.4 
Inadequate parent.| 11.2 8.4 12.7 14.7 3.9 
Family on relief.... 6.7 4.2 6.8 4.3 2.7 
Parent or sibling de- 

linquent or crimi- 

ES ae 8.5 1.5 6.2 2.6 1.2 
Insanity in family. . 1.3 1.3 2.4 3.0 6 
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family, or are an only child, or are the only boy among girls or 
the only girl among boys, than is true for the truants. How- 
ever, the incidence of these ‘position-in-family’ factors in the 
discipline group is practically the same as in the whole range of 
child-study cases, whereas the incidence among truants is 
definitely smaller, suggesting the hypothesis that such types of 
family position do not so much contribute to the development of 
behavior disorders as they militate against development of 
truancy. 

Third, we may list the characteristics of equal incidence in 
both groups. A wide variety of physical handicaps are reported 
for all these children. The two groups do not vary significantly 
from each other or from the whole range of child-study cases in 
the incidence of specific types of physical defect, except in the 
general item ‘unfavorable health history,’ already noted. As to 
educational factors, over sixty per cent of both groups have 
repeated one or more half-grades, and over forty per cent are at 
least a year retarded in present grade placement, as compared 
with the normal grade placement for their chronological ages. 
Considering only the pupils given achievement tests by the 
psychologist, the groups have median reading-comprehension 
grade-achievement scores of 3.2 and 3.4, respectively, and median 
arithmetic scores of 3.9 and 4.1 (not shown in the tables), though 
they are actually in median grade placement of 4.5 and 4.7, 
and have apparently median mental capacity for academic work 
at 5.2 and 4.8 grade levels. In other words, both groups tend 
to be working more than a year below their actual grade place- 
ment in reading and more than a half-year below in arithmetic. 
If their achievement is compared not with their actual grade 
placement, but with their mental capacity, the deviations are 
even more serious. As to social and family factors, about twenty 
per cent of both groups of children are reported to have unwise 
parental direction (about three times as large a percentage as 
for the whole range of child-study cases) and in about ten per 
cent of both groups the parents are described as ‘inadequate,’) 
meaning that there is evidence in the case history of drunkenness, 
drug addiction, feeble-mindedness, ignorance, etc. Actual 
known insanity in the family is reported rather infrequently, 
and equally for both groups. A foreign language is used in 
about fourteen per cent of the homes of both groups, but this is 
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about the same as the percentage for the whole range of child- 
study cases. 


ADOLESCENT SERIES 


When the adolescent truants are compared with the adolescent 
behavior problems, very similar relationships are found. The 
truants more frequently come from broken homes, more fre- 
quently from families on relief, or from families in which a parent 
or sibling is known to be delinquent. They have had more 
interrupted attendance at school, they show twice as great an 
incidence of lying or stealing. Factors more frequently associ- 
ated with truancy than with classroom disorder at the adolescent 
level, which did not appear as significant differences at the pre- 
adolescent level, include nail-biting, lack of self-confidence, and 
inadequate recreational provisions. 

When we look for characteristics which appear more serious 
among the ‘classroom disorder’ cases than among the truants, 
the same factors of nervousness, hyperactivity, poor work habits, 
aggressive anti-social behavior, and temper tantrums, mentioned 
for the pre-adolescent years, are found. There is still at this 
age a slight tendency for the only child or the only boy among 
girls or only girl among boys to show more discipline problems 
than truancy. However, the facts of being an eldest child, or of 
having a step parent, or being in a foster home no longer show 
significant differences of incidence between the two groups. In 
the area of educational factors, at the adolescent level, the 
discipline cases show more over-ageness, more discrepancy 
between grade placement and age, more reading disability, and 
slightly lower IQ (means 96.1 and 93.6, respectively). In this 
respect it should be noted that grade retardation and achievement 
deviations are apparently not as serious for the adolescent as 
for the pre-adolescent groups. 


COMPARISON OF TRUANT BOYS AND TRUANT GIRLS WITHIN THE 
ADOLESCENT GROUP 


Because of the increased percentage of girls within the adoles- 
cent truant group as compared with the other three groups of 
our main study, the girls and boys within this adolescent truant 
group were studied separately (there being four hundred one 
boys and two hundred sixty-one girls), to see whether any 
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of the characteristics previously noted for the adolescent truant 
group should be considered primarily in terms of a different 
sex composition. The outstanding result of this breakdown was 
the very slight difference in percentage of incidence of most of 
the factors, between these particular boys and girls. Con- 
sequently the complete tables are not presented here. Larger 
percentages of the boys than of the girls were reported as having 
withdrawn, unsocial natures (6.7 per cent to 3.8 per cent); more 
of them also showed aggressive, antisocial behavior (6.5 per cent 
to 3.7 per cent); and more had speech disturbances (5.2 per 
cent to 2.3 per cent). In the realm of family factors, larger 
percentages of the girls came from families on relief, from crowded 
homes, from foster homes, and from homes where a parent or sib 
was known to be delinquent, while smaller percentages of the 
girls than of the boys came from foreign-speaking homes. The 
first set of facts is consistent with the rather widely hypothecated 
concept that boys show a wider range of behavior symptoms 
(from withdrawal to agression) than do girls; the second, with the 
experience of school people that a more serious constellation of 
home and school and personality difficulties must develop to 
lead a girl into an overt departure from conventional behavior. 


SUMMARY 


The children of our series of cases who have histories of school 
truancy or of conspicuous class-room disorder have been shown to 
be children with a high incidence of other factors. They have 
many physical handicaps (vision, hearing, teeth, etc.) though 
perhaps not more so than children presenting other types of 
school problems, such as retardation, lack of ability etc., who 
have not developed conspicuous behavior deviations. They 
have, however, had more erratic school histories than these other 
children who have been referred to the Bureau of Child Study, 
they come from homes presenting many more social and family 
problems, and they show poorer personal adjustment. Both 
types of children suffer extreme educational retardation as to 
.grade placement, and even more as to achievement in the basic 
_ skill subjects. To what extent this retardation is cause and to 
what extent it is effect of the behavior problems it is, of course, 
impossible to say from such data as the present. 
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In general, children who choose truancy rather than classroom 
disorder as a method of escape from the tensions of the school 
situations have more home problems: crowded homes, broken 
homes, families on relief, parents or siblings delinquent or 
criminal; step-parents in the home, or foster-home placement. 
Such factors are particularly apparent among adolescent girls 
who are truant. 

In adolescence, grade retardation and reading disability appear 
more prevalent among the pupils who have become conduct 
problems in the classroom than among those who have become 
truant. 

In our sample of cases, both types of behavior symptom are 
associated with more serious educational problems (grade 
retardation and achievement deviation) in the younger group, 
and with more serious home and social problems in the older 


group. 
There is some evidence that at the younger ages the fact of . 


being the eldest of several children, or the only boy among girls, 
or only girls among boys, or only child, militates against the 
development of truancy but not against behavior disorders in the 
classroom. This effect of position in the family appears to be 
much lessened if not lost by the time the child becomes adolescent. 








FACTORS IN STATE CHARACTERISTICS 
RELATED TO AVERAGE A-12 V-12 TEST SCORES! 


K. 8S. DAVENPORT and H. H. REMMERS:? 
Purdue University 


The A-12 V-12 qualifying examination described here was the 
first one given for the purpose of selecting a quota for placement 
in the college training programs of the two services. It was 
given in April, 1943, to more than 300,000 young men, either in 
high schools or colleges, and was probably the most extensive 
single day’s testing with a single test ever held in this country. 

The test was composed of verbal, mathematical and scientific 
items, and the scores had a close relationship with scores on the 
Army General Classification Test. Consequently, the test could 
perhaps be considered as a combination of a group ‘intelligence’ 
test and a general educational achievement test. 

It seemed that the state means could give a rough indication 
of some sort of educational level of the various states. In a 
previous paper! the writer reported high correlations between 
these state means and certain educational finance data, for 
example, +.80 with current per pupil expenditures. 

As a result of these data it seemed worth while to obtain the 
relationships between this test and other sociological, economic, 
and educational data. Table I indicates the nature of the 
variables and the size of the correlations. The variables were 
taken from John Gunther’s Jnside U.S.A. and give some indica- 
tion of the ‘goodness of living’ of a state. When the state means 
were correlated with other data, as shown in Table I, it was 
evident that certain other variables were either measuring nearly 
the same thing or were closely allied with the test means. Since 
there was only one measure of educational achievement, it was 





1 A version of this paper was presented at the APA Convention in Denver, 
September 10, 1949. 

2 The authors wish to acknowledge the courtesy of Dr. H. T. Chauncey 
in allowing them to use the A-12 V-12 data and Miss Lois Remmers and 
Mr. Paul Baker for assisting in processing the data presented here. 

3’ Davenport, K. S., and Remmers, H. H. ‘‘ Educational Achievement as 
Compared with Money Spent on Schools.”’ School and Society, 1945, 
61 :333-334. 
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possible to deduce that such achievement might be accounted for, 
in large part, by other variables. Obviously it was not necessary 
to have thirteen separate variables to explain the correlations in 
Table I. A factor analysis thus seemed to be a logical procedure. 

Certain difficulties, however, arose in making a factor analysis. 
It can be seen that many of the correlations are negative, and 


TABLE I].—ORrIGINAL Factor LoOADINGS* 











Factor 
Variable 
1 2 3 4 
1 .930 .146 . 204 .047 
2 .894 .201 .067 — .067 
3 .651 — .450 .396 — .371 
4 .700 — .157 — .056 .190 
5 .045 — .090 . 238 . 269 
6 .325 — .496 -— .451 — .301 
7 .832 — .488 —.178 — .124 
8 .695 .366 — .271 .126 
9 .852 — .133 .071 .125 
10 .913 .049 .185 .046 
11 .496 .561 — .105 . 267 
12 .776 .342 — .273 — .315 
13 .857 . 238 .190 — .191 

















* Variables 4, 7, 9, 11 reflected from original matrix (Table I) 


some highly so. The typical factor analysis begins with a 
positive matrix; there was no reason, however, why the original 
matrix should not have certain variables reflected before any 
factors were extracted. Variables 4, 7, 9 and 11 were so reflected, 
thus giving an essentially positive matrix. Extraction of the 
factors was then carried out by the usual procedure, one addi- 
tional problem being recognized. Since most of these data were 
population data, there was a problem in knowing the size of the 
residual which could be accounted for in terms of chance. The 
writers arbitrarily set a residual of .10 or smaller as being a 
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chance residual; after extracting four factors the procedure was 
stopped since there were only two residuals of the size of .10—all 
others being less than .10. 

Table II gives the original factor loadings, with the notation 
that the variables which were reflected in the original matrix 
(Table I) were kept so deliberately. Since these were logical 
reflections, one need merely reverse the meaning of the variables 
to make them clear. For example, variable 4, number of lynch- 
ings per hundred thousand, when reflected, could be considered 
lack of lynchings per hundred thousand, and variable 7 would be 
lack of Negroes per thousand. These reflections should be 
remembered during the subsequent discussion. 

As Table II is scanned, it can be seen that factor 1 has by far 
the heaviest loadings. The other three factors are much less 
highly saturated and perhaps are of lesser importance than factor 1. 

Attempts were made to rotate the factors to meaningful struc- 
ture, but, again, with all factors being essentially bi-polar, the 
typical procedure of maximizing on one factor and minimizing 
the negative loadings on the other factors proved to be relatively 
meaningless. A rotation to extract a ‘principal’ factor likewise 
proved to be of little value. Consequently the loadings were 
given a simple rotation through the centroid, resulting in the 
factor loadings shown in Table III. It will be noted that very 
little change was made by rotation in any of the factors, the 
greatest change coming in factor 4. After rotation, of the total 
contribution to the variance (sum of factor loadings squared), 
factor 1 contributes 72 per cent; factor 2, 14 per cent; factor 3, 
8 per cent; and factor 4, 6 per cent. 

The name of the first factor was seemingly obvious, but the 
other factors proved to be much more difficult for extracting a 
general principle for naming based on their loadings. Factor 1 
is almost surely a state economic factor. Extremely high load- 
ings are shown for variables 1, 2, and 10, with these variables 
being used frequently in determining a state’s economic ranking. 
Loadings of .930, .894, and .913, respectively, for these factors 
(1, 2 and 10) indicate that these three variables are almost wholly 
measuring one thing. 

Factor 2, with high positive loadings on variable 11 (note that 
this variable has been reflected) and variables 8 and 12, and with 
high negative loadings on variables 3 and 7—7 being another 
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reflected variable—seem to indicate that this is a rural-urban 
axis, with rural on the negative side and urban on the positive 
side. States that were high in possession of libraries, in foreign- 
born, and in residents in Who’s Who are predominantly urban; 
while states that have high automobile registrations and a low 
proportion of Negroes are predominantly rural. 


TABLE IIJ].—Factror LOADINGS AFTER ROTATION* 











Factor 
Variable 
1 2 3 4 
1 .930 .136 .202 .080 
2 .898 .194 .069 — .035 
3 .659 — .443 .403 — .353 
4 .692 — .170 — .065 211 
5 .036 — .099 .228 .270 
6 .330 — .492 — .448 — .298 
7 .831 — .492 — .180 — .10] 
8 .694 .354 — .273 .152 
9 .846 — .145 .064 .152 
10 .912 .039 .182 .077 
11 .493 .547 — .109 . 289 
12 .789 344 — .261 — .286 
13 .865 . 236 .197 — .160 

















* Variables 4, 7, 9, 11 reflected from original matrix (Table I) 


The third factor cannot be definitely identified, but it seems 
likely that it is a geographical factor, that is, a deep-South 
versus non-South axis. For example, states which are high in 
automobile registrations (variable 3), with a positive .396 load- 
ing, are not in the South; while states with a low proportion of 
soldiers killed in World War 1, with a negative .451 loading 
(variable 6), arein the South. This latter fact may be accounted 
for, probably, in standards of selection and of soldier capabilities. 
The other positive and negative loadings seem to support this 
tentative naming. 








Factors in State Characteristics 115 


We have not yet named factor 4—we are unable to pick out 
what is left, for example, in variable 3, when income, urbanity, 
and geographical location have been accounted for. The same 
question arises when variables 11 and 5 are considered. This 
factor is undoubtedly important, for it has substantial loadings 
on ten of the thirteen variables, and has a 6 per cent contribution 
to the total. 

As a final statistic, the multiple correlation between the cri- 
terion of the A-12 V-12 test means and variables 3, 6, 8 and 10 is 
.962, indicating that from these four variables one could predict 
with little error the standings of the individual states on the test 
means. 

It should be recognized that this test was given in 1943 and 
that there may have been great changes in the complexion of the 
states since then. It seems to the writers, however, that there 
is considerable food for thought in the results of the foregoing 
analysis; income is generally recognized as being a desideratum, 
if not a necessity, but it has not been so frequently recognized 
that it is of such major importance in educational achieve- 
ment. When it is considered that the factor loading on factor ! 
for the test is .857, that more than 70 per cent of the contribution 
to this educational variable is that of income, then a state’s 
income must be heavily weighted in discussion of state educa- 
tional achievement—if the hypothesis that this test is a reason- 
ably good measure of such achievement be accepted. 

These data are all state data; they do not apply to individuals. 
Without much facetiousness, however, we interpret these results 
to mean that the probabilities of reaching a high educational 
achievement are much greater if one comes from a high income 
state which is highly urban, which is not in the South, and which 
has such advantages as library service available to most of its 
population, has a high proportion of foreign-born citizens, a large 
number of residents in Who’s Who, and many telephones. 








USE OF THE MINNESOTA MULTIPHASIC 
PERSONALITY INVENTORY IN SCREENING 
COLLEGE STUDENTS FOR COUNSELING 
PURPOSES 


GLENN R. HAWKES 


Utah State Agricultural College 
Logan, Utah 


It has become apparent to college workers that many students 
fall short of realizing their full capabilities because of lack of 
adjustment. To meet this condition, more and more colleges 
and universities are instituting and developing counseling 
services. Because of the increased cost of such service and the 
extended time involved, it has also become evident that any 
device which improves the efficiency of counseling is highly 
desirable. Since the signs of latent personality disturbances 
and, in many cases, even existing maladjustment, are often not 
revealed in overt behavior, devices which would aid counselors 
in selecting from a large population the individuals having prob- 
lems of personal and social adjustment or who are likely to 
develop these problems would be very useful. 

In this investigation, the Minnesota Multiphasic Personality 
Inventory (MMPI), a device which has been found valid in other 
situations,':* is evaluated with the intent of discovering how 
useful this inventory is in determining maladjustment in college 
life. Specifically, this study determines to what extent scores on 
this inventory earned by students when they enter college will 
be predictive of maladjustment which may develop later in 
several aspects of college life. 

In an effort to measure the ability of the MMPI to predict as 
stated above, it was administered to the entering freshmen at 
Utah State Agricultural College, Logan, Utah, for the school year 
1947-48. This group of a little over one thousand one hundred 
comprises the population from which the subjects were selected. 

In order to derive data which could be tested for statistical 
significance, the following general procedure was used to select 
subjects for study: 


It was found that fifty-two male and eleven female subjects 
116 
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deviated two sigmas above the mean on the MMPI areas of 
Hypochondriasis, Depression, and Hysteria. These subjects 
were selected for an experimental group. Due to disqualifying 
validity scores, non-availability of subjects, withdrawal from 
school prior to the setting up of the problem, the group was 
reduced to twenty-nine males and eight females. 

This experimental group was matched subject for subject with 
twenty-nine males and eight females whose scores fell within the 
normal range as defined by the authors of the MMPI. Criteria 
for equating were as follows: same age, sex, class rank in college, 
and equivalent scores on the United States Armed Forces 
Institute tests of Effective Usage of English and Readings in 
Natural Science. Tests of significance of the equating scores 
revealed that the groups did not differ significantly. Such 
differences that were found later, therefore, were attributed 
largely to differences related to areas of the MMPI. 

The selected subjects were then examined for differences in 
the following areas: (a) Interest, range and pattern, as revealed by 
the Kuder Preference Record, (b) Grade-point ratio for the 
academic year 1947-48, (c) Referrals to the Deans of the College 
for discipline, low scholarship, or commendation, (d) Ratings by 
faculty advisors using a rating scale, (e) withdrawals from school 
during the course of any quarter of academic work, (f) a single 
interview in order to determine social participation, objective in 
college study, overt manifestations of maladjustment, facility of 
expression, manner, etc. These areas were selected for three 
reasons: to the investigator it appeared plausible that students 
with personality disturbances might be expected to reveal their 
maladjustments in these ways. In at least one area (range of 
interests), previous research had indicated such areas as were 
studied were related to general maladjustment.‘ Finally, data 
on adjustment in these areas were available to the investigator. 

The following procedure was established for deriving the data: 
The Kuder Preference Record which was administered in the 
battery given prior to registration was used to determine the 
fitness of the stated college objective. The stated college 
objective was determined in a single short interview. In deter- 
mining the fitness of the objective with measured interest, the 
present objective was compared with suggested occupations for 
specified interest patterns. The Kuder Preference Record 
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Manual with the suggested occupations was used as the criterion. 
Arbitrary numerical values were assigned based on degree of 
fitness. The results were tabulated and tested for significance. 
A critical ratio of 2.81, significant at the one per cent level, was 
found which indicates there is a statistically significant difference 
between the experimental and control group in the fitness of their 
selected objective as compared with interest patterns yielded 
by the Kuder Preference Record. 

On the basis of Berdie’s research,‘ one might postulate that 
the neurotic person’s interest is relatively flat when plotted 
vertically as opposed to the number of peaks shown for well- 
adjusted individuals. The nine Kuder Preference Record per- 
centile scales were plotted on a Kuder psychograph. They were 
then assigned a numerical value as they deviated from the mean. 
This value increased at the rate of 1 point for each 5 percentile 
points. Values were ruled as positive in negative or positive 
deviation, inasmuch as they indicate either positive or negative 
peaks. The type of peak was not thought to be significant. 
A total score for peakness and flatness was thus obtained. A 
critical ratio of .88 was yielded in comparing the experimental 
and control groups. This is not significant but indicates a 
tendency in the direction indicated. 

At the time of the interview, both experimental and control 
subjects were questioned as to their present college objective, 
previous objective if changes had been made, and their plans for 
college objective made prior to entering school. The results of 
these questions were then tabulated and given a numerical value. 
It was hoped that such determination would indicate the stability 
of the interests of the subject. Arbitrary numerical values were 
used in ascending order commensurate with the stability shown. 
The tabulated results of this phase showed no differences. 

Adjustment to college life and the various demands made 
upon the individual by successful college work are no doubt 
reflected in scholastic achievement. To substantiate this a check 
of grade-point ratio was made. A critical ratio of 1.77 was 
yielded. This fails to be significant at the five per cent level 
but may indicate a trend of lower scholastic achievement for the 
experimental group. 

It was stated in the hypothesis of the problem that maladjusted 
students would be referred to the deans most often for discipline 
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or low scholarship. This premise was tested by contact with the 
deans and no significant differences between the number referred 
in the two groups was obtained. 

Inasmuch as the faculty advisors are most likely to have 
information about a student, they were contacted regarding the 
subjects. To facilitate this information gathering and in order 
to preserve as much objectivity as possible, a rating sheet was 
devised. This rating sheet is typical of inventories such as the 
Haggerty-Olsen-Wickman behavior scale. The raters were 
cautioned to preserve objectivity as far as possible. In deter- 
mination of statistical significance a critical ratio of 1.46 was 
yielded. This fails to reach statistical significance. 

In a check of the area of withdrawal from college no statistical 
significance between the two groups was found. 

Another phase of the experiment was to conduct a short well- 
controlled interview with each of the subjects. An attempt was 
made to determine the extent of social participation of the sub- 
ject in the college and community. To preserve objectivity a 
random order of interviewing was selected and the experimenter 
was not aware whether the subject was experimental or control. 
The subject was asked about the extent of participation and then 
numerical values commensurate with this participation were 
assigned. A critical ratio of 2.53 was yielded which is significant 
at the five per cent level. This indicates that groups of better 
adjusted individuals participate more in social activities. 

In addition to vocational objective and stability of objective, 
and extent and nature of social participation, the subjects were 
rated on facility of expression, appearance, attitude, and overt 
signs of maladjustment. Comparison of the group in this factor 
yielded a critical ratio of 1.69 which shows no significance but 
indicates a trend in favor of the control group. 


SUMMARY AND CONCLUSIONS 


A tabulation of all results is given in Table I which has been 
prepared in order to summarize and integrate the data presented. 
In two of the six instances, a significant critical ratio was found. 
The first hypothesis, that the control group would select objec- 
tives more in keeping with their measured interests, was con- 
firmed. The difference here was significant at the one per cent 
level. For the fifth hypothesis, that the control subjects partici- 
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pated more socially, a difference, significant at the five per cent 
level was found. There exists a real difference between the 
groups in these two areas. The importance of these two areas 
to college adjustment, where the differences are significant, is 
indicated by Finch and Nemzek® and by Hill® who concerned 
themselves with social adjustment because of the weight attached 
to this element of college life. It also seems to the writer that a 


TABLE I.— TABULATION OF RESULTS IN THE USE OF MMPI In 
SCREENING COLLEGE STUDENTS FOR COUNSELING PURPOSES 








Mean Crit Level |Direct. 
Area Measured “od of of 
Exp. |Cont. Signif.| Diff. 





Fitness of college objective 
compared with Kuder Pref- 
erence Record 3.10) 3.72) 2.81) .01 | Cont. 

Peakness and flatness of inter- 
ests as revealed by Kuder 


Preference Record 53.41/55.41| .88) Not | Cont. 
Grade-point ratio 1.25) 1.74) 1.77) Not | Cont. 
Numerical values of rating 

scales 20.20)16.61) 1.46) Not | Cont. 
Numerical values of social par- 

ticipation 79.94/84.32) 2.53) .05 | Cont. 
Numerical values of social im- 

pression 20 .91/22.64/) 1.69} Not | Cont. 




















properly selected vocational objective which is closely related 
to the student’s interests will assist him in adjustment to the 
college situation. 

In the remaining four areas where differences were computed, 
it was found that the difference in each case failed to reach statis- 
tical significance. It should be noted, however, that the trend 
in all of the measures was in favor of the control group. Pos- 
sibly, had other areas of study been selected, differences in quality 
of adjustment might have been revealed more sharply. Failure 
to find differences of statistical significance in certain areas does 
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not necessarily invalidate the device; it may lead one to question 
as to whether these checks were appropriate. 

It seems justifiable to conclude, then, that some differences 
between the groups exist and that this device will predict these 
differences in at least two important areas. This indicates the 
value of using the MMPI as a screening device for college counsel- 
ing. Students who are revealed by the device as maladjusted 
might well be assigned to an advisor skilled in personal adjust- 
ment counseling. This would more adequately utilize the serv- 
ices offered and make a guidance program more effective because 
stress is laid where it is apparently needed. Our results also 
indicate that the use of the device would not assure that all 
students in need of adjustment counseling would be detected, 
and that some students would be ‘identified’ who are found later 
not to need such help. 
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BOOK REVIEWS 


FLORENCE L. GooDENOUGH. Mental Testing: Its History, Prin- 
ctples, and Applications. New York: Rinehart and Co., 
1949, pp. 609. 


Those who have admired and profited from the works of Dr. 
Goodenough throughout her career will be delighted that she has 
produced this volume. In it she looks at four decades of mental 
testing, lays bare the issues of most importance, and evaluates 
the progress that has been made. Her comments acquire impact 
both from her wisdom and experience, and from her no-non- 
sense style. Because this volume tries to cover all her view- 
points, the contents are extremely varied. There are sections on 
all types of testing, including motor development, ratings of 
social behavior, and projective tests as well as tests of the Binet 
genre. Because she equates critical thinking with statistical 
thinking, there is a series of chapters on sampling and statistical 
methods through analysis of variance. Several concluding 
chapters, much less meaty, survey the use of tests in schools, 
clinical practice, industry, social work, etc. 

Goodenough covers knotty problems of mental-test theory 
which have been adequately restated in no modern book. There 
is, for example, a careful analysis of the scaling procedures of 
Heinis, Woodrow and Arthur, van Wagenen, and others. She 
makes considerable use of a provocative distinction between 
tests as samples of behavior, and test performance as a sign of 
traits. Another asset is a very satisfying history of early 
developments in testing. 

Comparatively little space is given to describing tests or to 
citing evidence. Instead, Goodenough presents a personalized 
evaluation of each area. Often these comments are on the 
devastating side; scarcely a chapter dealing with work after 
1916 is without such phrases as ‘statistical illiterates,’ ‘insufficient 
controls,’ or ‘blunders and false conclusions.’ Her position is 
conservative, and so will please some readers more than others. 
While she is open-minded on projective tests, for example, she 
chooses to approach them through a detailed consideration of 
Binet’s case studies of his daughters, and then is quite explicit 
that the moderns have lacked the insight and the technique to do 
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as well as he in the same area. Some of her treatment is open to 
criticism. She recommends using vocational aptitude tests of 
the Minnesota variety in a way the reviewer considers insuf- 
ficiently critical. Her unqualified stress on the desirability of a 
normal distribution of test scores disregards recent thinking 
about maximum discrimination. Her suggestion that reading 
readiness tests are to be used in deciding whom to admit to first- 
grade does not consider their use in planning a suitable school 
program for every six-year-old. 

While every reader will find something to disagree with in so 
uncompromising a book, no psy choogist or educator can come 
away from the book without fresh insights. It is particularly 
valuable to have attention drawn to some of the underlying 
problems and assumptions which are ignored when testing 
becomes a business or a technology. Because of Goodenough’s 
perspective and tough-mindedness, her book will make a distinct 
contribution to the education of the advanced student. 

LreE J. CRONBACH 

University of Illinois 


ALFRED A. STRAUSS AND LaurRA E. LEHTINEN. Psychopathology 
and Education of the Brain-Injured Child. New York: 
Grune & Stratton, 1947, pp. 206. 


Children physically handicapped or sound who show intel- 
lectual or personality aberrations as a result of injury to the brain 
substance is what this book concerns itself with. Content, 
methods used and general approach toward working with brain- 
injured children described in this volume will be of distinct value 
to all people interested in the education of the brain-injured 
child. The volume has been written by the president and the 
educational director of the Cove Schools for Brain-Injured 
Children at Racine, Wisconsin. The two authors have had 
nearly twenty years of experience in studying and working with 
these children, and they have learned much from these experi- 
ences. The book itself is divided into two parts. Eight chap- 
ters are devoted to psychopathology which composes Part I. 
Part II is composed of four chapters on the education of the 
brain-injured child. Also there is an appendix which includes an 
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unpublished essay on the brain-injured deaf child written by 
Mary Agnes Blair, references and an index. 

In general, this is an extremely well-done job. The part on 
psychopathology is clear, concise, illustrative, intelligible and 
comprehensive. It includes chapters on historical review of the 
literature, consideration of the anatomy of the brain and its 
function in the relationship to its foundations for considerations 
of some problems of the brain-injured child. Topics considered 
include perception and perceptual disturbances, thinking dis- 
orders, behavior disorders, testing the brain-injured child, clinic 
and diagnosis of brain injury on children, and the concept of the 
exogeneous child versus the endogenous child. The part on 
education includes consideration of general principles, and 
chapters on teaching of arithmetic fundamentals to the brain- 
injured child, teaching reading, and teaching writing. Reports 
of the results of their own studies and the evaluation of the con- 
tribution of such people as Kurt Goldstein and Doll are all well 
done. It is the most compact and comprehensive volume on 
this topic which has come to the attention of the reviewer. 

H. MELTZER 

Psychological Service Center 

St. Louis, Missouri 


D. Snrac anp A. W. Coss. Jndividual Behavior. New York: 
Harper and Brothers, 1949, pp. 386. 


This book presents ‘‘A New Frame of Reference for Psy- 
chology,”’ phenomenological psychology. ‘All behavior... 
is determined by . . . the phenomenal field of the behaving 
organism,” not by objective reality, but by the situation as the 
organism perceives it. The task of understanding behavior is 
that of understanding or reconstructing the behaver’s perceptual 
field. The task of predicting behavior becomes one of predicting 
how the behaver will perceive a situation at a future time; i.e., 
predicting his phenomenal field. There are two ingredients in 
the phenomenal field: the field of objective reality and the 
behaver himself—the ‘phenomenal self.’ Thus there are two 
ways open to changing behavior—changing the objective field 
and changing the phenomenal self. This general idea is as old 
as Herbart, at least;'and except for the fact that ‘apperceptive 
mass’ is much less dynamic, that term might be substituted for 
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‘phenomenal self.’ The general idea is consonant with William 
James’s declaration that “whilst part of what we perceive comes 
through our senses from the object before us, another part (and 
it may be the larger part) always comes out of our heads.”’ 

While phenomenological psychology lies in the field of field 
psychology and is regarded by some to be a radical branch, this 
book draws less upon field data than I anticipated. It draws 
freely from the data of traditional psychology. Except for some 
of its proposed experimental methodology, there appears to be 
little in it that is incompatible with functionalism or with Wood- 
worth’s general standpoint. Carr’s treatment of perception and 
development of the self seems about as dynamic as that found in 
this book and in many respects is quite similar. I think one 
would be hard put to find many examples in Woodworth of the 
neglect of the individual in behavior which is attributed to objec- 
tive psychology. However one may view the “new frame of 
reference’’—perhaps it will be better received by clinicians than 
by experimentalists—it is a very competent work. It is fresh 
and crisp in style and thought. The educational psychologists 
and, for that matter, classroom teachers should find it particu- 
larly valuable. The chapters entitled, “‘The Goals of Education” 
and “The Task of the Teacher,” are outstanding. Other 
chapters that should make a strong appeal to this same class of 
readers are “‘The Way We See Oursevles,”’ ‘‘The Phenomenal 
Self in Action,”’ “People Under Threat,’”’ and “Social Structure 
and Action.” 

The main orientation of the book is clinical. A good share of 
its latter portion is devoted to diagnostic and therapeutic pro- 
cedures. J. B. Stroup 


State University of Iowa 


JEAN Paut Sartre. The Emotions. Outline of a Theory. 
New York: Philosophical Library, 1948, pp. 97. 


In this short volume John Paul Sartre, better known for 
existentialism than psychology, attempts to outline a theory of 
emotions that can be read and understood but not. in terms of a 
background of psychology as it is known in the United States 
today. This is instead a phenomenological study. In this little 
volume are considered the contributions and general significance 
of James, Janet and the viewpoints of Kohler, Lewin and Dembo. 
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Dembo is one of the heroes of the book, in a sense, since he more 
than James or Janet represents an orientation that Sartre thinks 
he follows. Of Janet he says that he was too uncertain, divided 
as he was between a spontaneous finalism and a fundamental 
mechanism, whereas in Dembo and Lewin he finds the first 
draught for expounding the pure theory of emotion and behavior. 
Sartre himself advises that the pages of the book should be 
regarded as an experiment in phenomenological psychology. In 
his words he says ‘“‘we shall try to place ourselves on grounds of 
signification and to treat emotion as a phenomena,” and this 
he does with the framework of concepts and words that will have 
some familiarity to American psychologists, but relatively little 
significance as far as influencing ways of investigation or interpre- 
tation. Illustrative of the nature of words and manner in which 
Sartre uses them in the book may be of interest. Some things are 
expressed in a startling manner as if they were revelations which 
are fairly obvious facts. On the other hand, other ideas are 
expressed in a flow of words where the meaning gets lost even 
though it is supposed to have significance. 

Psychologists, says he, differ in their theories but agree that 
they should start before anything else with facts. Psychologists 
who might be in agreement about the fact that they should not 
accept their own existence in an a priort manner would be sur- 
prised to find that they are supposed to discover it in any other 
way but by observing that man is a man because he has the 
characteristics of aman. The general orientation and the search 
for the kind of significance that Sartre is known for is indicated 
in the last two sentences of the book which read as follows: 
‘That there are such and such emotions, and only these, mani- 
fests without any doubt the factitiousness of human existence. 
It is this factitiousness which makes necessary a regular recourse 
to the empirical; it is this which, in all likelihood, will prevent 
psychological regression and phenomenological progression from 
ever coming together.’”’ And this is a tragic situation which few 
psychologists will bewail. Brilliant, some literary people have 
called this volume. Interesting reading to some psychologists 
this book can be. The curiosity of the reviewer is in what made 
Sartre take time off to write such a book. H. MELTzerR 

Psychological Service Center 

St. Louis, Missouri 
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T. W. Ricuarps. Modern Clinical Psychology. New York: 
McGraw-Hill Book Co., 1946, pp. 331. 


The rapidly growing field of clinical psychology can profit from 
a literature which is modernized as well as validated. Large 
scale production and good quality control do not necessarily go 
together in clinical psychology any more than they do in other 
endeavors. In Modern Clinical Psychology Dr. Richards attempts 
to do a very difficult thing; namely, to write a book designed for 
professional students at a level that can be understood by the 
average college junior who has had at least one year of general 
psychology. What he favors is a dynamic approach, and by 
this he means an emphasis on the viewpoints connected with 
such names in the field of personality explorations as Murray, 
Rorschach, Klopfer, Freud and Jung. The clinical psychologist 
as considered in this book is concerned with the behavior of a 
particular individual, with the emphasis on the practical phases 
of behavior; in which respect the clinician resembles the clergy- 
man, the personnel manager or the physician more than the 
general psychologist. The ability to understand others is viewed 
by the author as an intuitive gift, and the function of clinical 
psychology is to help improve this gift. 

The heart of the content are seven chapters on appraisal of per- 
sonality—two on the appraisal of capacity, two on the appraisal 
of motivation, and three chapters on the appraisal of control. 
These chapters on appraisal are prefaced by four chapters that 
serve as an orientation to the consideration of the problems of 
appraisal. The chapters include consideration of psychology as 
a specialty, methods of psychological appraisal, approach to the 
patient and physical examination. The appraisal chapters are 
followed by two chapters, one on precipitation and disposition, 
and one on readjustment. The book also includes a fairly 
adequate appendix, bibliography, and a list of visual aids as 
well as an index. 

In one sense the book deserves to be called modern. It is 
different from previous books; it does pay attention to some of 
the more recent tools for the study of personality that are getting 
a good deal of attention—projective techniques, the Rorschach, 
the T.A.T., and the Minnesota Multiphasic. The author says 
the book attempts to integrate his personal experience in what he 
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conceives to be the specialty of clinical psychology. There is 
no denying that this is his purpose. What can be questioned is 
the extent to which practice and literature has registered with the 
author and practice has been fully understood. In spots it is 
uncritically modern. There is nothing that says that everything 
modern is necessarily good, and everything that has a history 
behind it and has survived is necessarily bad. Comprehensive 
this book is not. If wisdom from broad living and reading is to 
be expected in a book on clinical psychology, one will be dis- 
appointed here. It does have a good deal of information about 
tools and knowledge, that clinical psychology does at the present 
time apply, which can serve to inform untrained people. The 
Multiphasic is over-used and uncritically so. Case study 
materials used do not signify the kind of an experienced clinician. 
Instead, they give the impression that it is a man who has 
searched for illustrations, rather than one who has selected them 
from experience. There is only one reference to Dr. William 
Healy’s work, and this is a mention to the Healy Picture Com- 
pletion Test. Was Healy not modern enough? The con- 
sideration of introversion-extratension concept is not critical. 
Reading disability is practically a neglected problem, though 
homosexuality is treated at some length. 

All in all, what can be said of this book is that it can serve as a 
valuable reference book for students of clinical psychology. But 
the author made too many attempts to satisfy too many con- 
flicting demands in selection and writing of the book. As it is, 
it is not deep, profound or understanding enough for graduate 
students of clinical psychology on the one hand, and presupposes 
much too much content for a person who has had only one year 
of clinical psychology to be able to make intelligent use of it on 
the other. The book, then, from the point of view of the reviewer, 
definitely does not satisfy the purpose for which it was written, 
but can be used to advantage as a reference work. 

H. MELTzEeR 


Psychological Service Center 
St. Louis, Missouri 














